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Director's Statement 




Recent reports have indicated a declining 
emphasis on science, mathematics, and engi- 
neering education in the United States. In con- 
trast, other industrialized nations are providing 
rigorous technical training for their youth. 
This situation presents a serious threat to the 
Department of Energy's (DOE) ability to 
maintain a supply of highly educated and 
trained scientists, engineers, and technicians to 
carry out DOE's mission in energy and defense 
research and development. To ensure the fu* 
ture economic competitiveness of this nation, 
we must strengthen our national technical 
competence. 

Los Alamos National Laboratory's (LANL) 
interest in education is prompted by the neces- 
sity of our nation to provide a continuous sup- 
ply of qualified scientists, engineers, and tech* 
nicians. Therefore, I was pleased to have the 
Cognitive Systems Engineering (CSE) Group 
of the Analysis and Assessment Division host 
the Distance Learning Conference at the Inn 
of the Mountain Gods in Ruidoso, New Mex- 
ico, in October 1989. 

The strengths that the DOE laboratories 
bring to education are a wealth of unduplicated 
scientific resources and a collective experience 
Siegfried S. Hecker, Director with successful science education activities. 

In the decades since the war, our primary 
mission has been to apply science and technol- 
ogy to national security problems, ranging from 
defense to energy research. The nation has 
expected the Laboratory to provide creative 
but practical solutions to complex problems. 
The results of the distance learning conference 
have demonstrated the need to begin leveraging 
technology to improve learning now. 
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Prologue 



In October 1989, the Cognitive Systems Engineering Group of the Analysis and Assessment 
Division of the Los Alamos National Laboratory hosted a distance learning conference at the Inn 
of the Mountain Gods in Ruidoso, New Mexico. The conference participants-^iighly respected 
representatives of militaiy, government, industry, and academia-analyzed the potential of distance 
learning to deal with comnion educational problems. The group exploded the distance learning 
problem, media, interactivity, instructional strategics, collective learning, student performance 
evaluation, and implementation of a national distance learning strategy. The figure below illus- 
trates the order in which the various conference topics were addressed. 




The assembled participants scrutinized ways that distance learning advocates could communi- 
cate the concept to the public. They also sought acceptance of distance learning as a recognized, 
effective delivery system for enhancing current education and training ^stems and implementing 
lifelong learning strategies. Participants acknowledged that distance learning forces us to return to 
design and consider how technology can help us improve the status of education. The attendees 
agreed that distance learning should be a national priority and could be applied to national 
problems at all levels. 

For the brainstorming sessions, the participants were arbitrarily assigned to four small groups 
(A, B, C, and D), which included people from varying discipliRes> A two-column format has been 
used in each article to denote these small-group sessions, and the reader should not infer LANL 
endorsement of the material included. The small-group membership changed once during the con- 
ference. 

The Cognitive Science Engineering Group members opened each large-group session ./ith a 
brief presentation, the essence of which is included in the proceedings. The author ir identified ir 
each document, but readers should be aware that the conference participants and note takers in 
each session were responsible for the small-group session input and results. 
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These proceedings include not only the basic text of ihe presentations but also an account of 
the large- and small-group sessions. The individual session reports read more like log books than 
scholarly papers because they documeni whai aciuaily happened in the suiaU-group sessions. A 
participant who has been conducting a distance learning project for many years saic' that by read- 
ing the£^ proceedings, you will learn more than you could by doing a yearns worth of literature re- 
view. This section summaHzes the entire conference. 

Background • • j 

The idea of holding a distance learning conference originated in March 1989. We identified 
potential participants (see page 51 for attendee list). We realized that witnout a national orga- 
nization dedicated to distance learning, some expert.^ v/ould be missed. Subsequent to the con- 
ference, Michael Moore of Pennsylvania State University initiated the creation of such an organi- 
zation. 

The national education crisis encompasses declining standardized test performance, the num* 
ber of functionally illiterate people in the nation, and a perceived apathy toward learning in gen- 
eral. In addition, a major concern prevails regarding rising educational costs. These expenses in- 
clude the fixed costs of the institutions, the salaries of the teachers and administration, and the 
value of depreciable and oqpendable educational materials. In short, we need to raise the equality 
and quality of American education while limiting escalating costs. Therefore, distance learning is a 
potentially attractive alternative to supplement traditional forms of l earning. 

The Conference 

The conference was held over a three-day period and followed a rigid, predetermined program. 
Attendees, other than Los Alamos participants, were not obligated to make advance preparations. 
This approach was taken to enhance participation in this first conference. Instead, Los Alamos 
personnel prepared remarks for each session to introduce topics for discussion. These remarks of- 
ten contained premeditated, pejorative statements to stimulate debate. 

For this conference, distance learning was defined as learning that takes place without the 
physical presence of an instructor. We felt a broad definition was important to preclude focusing 
on a specific medium. Indeed, based on their experiences, many participants arrived with nar- 
rower interpretations of distance learning, but they readily accepted the broader definition. 

The Distance Learning Problem 

The central theme to this discussion was distance learning. What problems can it help solve? 
What are the problems associated with effecting the solution? Smad groups identified problems 
on a national level and within the educational, military, and industrial communities. The single, 
common theme was the necessity to instill a lijfelong learning attitude or value. This point is sig- 
nificant because no group specifically addressed kindergarten through twelfth grade education, yet 
each identified a value that should be ingrained in those years As a nation, we are entering an age 
of constant learning and changing technology. 

At the national level, priorities were identified for the emergence of distance learning as a vi- 
able alternative to traditional classroom instruction. Distance learning causes the emergence of 
new concepts of educational and training institutions. If distance learning is to fulfill its potential, 
the nation needs to be enlightened about all distance learning technologies. 

Among the education, military, and industrial groups, additional common themes emerged: to 
provide quality learning to physically and geographically dispersed personnel, to remotely access 
learning systems, and to instruct educators in new technologies and instructional strategies because 
of rapidly changing knowledge bases. 
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Media 

The session acknowledged the importance of media as a vehicle for lesson presentation, inter- 
action, and assessment. Generally, our ability to use the capacity of the media is the limiting factor 
in distance learning effectiveness, not the media itself. 

Two questions were posed to the small groups. Both dealt with identifyuig the available media 
that are the most effective for distance learning and the new developments that can be anticipated 
in the future for ^ecific media: print, audio/video, computer-based training, or synchronous 
telecommunications. The participants agreed that individual media cannot be assessed in isola- 
tion. Almost without exception, combinations of media are used to create a training system. 

The difference between media and delivery was an issue among all groups. The distinction is 
further clouded by breaking media down into parts that represent, transmit, or produce lesson 
material. Although no one group reached clear insight or resolution, participants generally agreed 
that this problem warrants and requires further investigation. 

Interactivity 

Interactivit>" is a neces^ry condition for learning to occur. The learner must accept the in- 
formation provided, process it, and internalize it. Motivation is closely linked to interactivity in the 
sense of intrinsic motivation of Herzberg's two-factor theory. Michael Moore's definition indicates 
that learning is a two-way interaction between the student and the teacher, the subject niatter, and 
classmates. The small group expanded this definition to include media and tutors. Additionally, 
the participants suggested that some level of interactivity is needed in distance learning because 
people generally are not autonomous learners. 

Consensus indicated that motivation and interactivity should continue to be treated as separate 
entities. However, the precise interrelation of motivation and interactivity is less important than 
acknowledging the relationship. Instead, it is more important to concentrate on creating high- 
quality interact^vitv that stimulates learning while addressing motivation separately. 

New gUi. . ror distance learning interactivity are urgently needed. The distance learning 
paradigm is compatible with, but different from, traditional edu'->4tion. Therefore, distance 
learning developers, instructors, and teachei*s require different skills to be effective in distance 
;*^arning. For example, one cannot place a classroom teacher before a TV camera and simply say 
"teach." 

Instructional Strategies 

An instructional strategy is the teaching method approach used to help students fulfill objec- 
tives. Traditionally, little emphasis has been placed on instructional strategies in distance learning; 
the focus instead has been on technology. Differing requirements demand appropriate strategies. 

Instructional strategies include Nocture, drill and practice, tutorial, gaming, simulation, coach- 
ing, dialogue, and collective learning. The last five strategies have rarely been used in distance 
learning. This session explored gaming, simulation, coaching, and dialogue, which require a com- 
puter for deiivery and involve incorporation of the instructor's knowledge and skills into the com- 
puter software. Highlights of the discussion of the four strategies follow: 

Gaming. Games are challenging to design from an instructional sense, but they can be very ef- 
fective if designed well. They can stimulate not only high-cognitive-level learning but also collab- 
orative work. 

Simulation. In a simulation, the student manipulates a working model of the system being 
studied. Simulation is a very powerful strategy, especially for applications where safety is a 
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concern and the consequences of inadequate training are dire. High development and delivery 
costs were a concern, but recent technological advances are increasing desigr. feasibility. 

Coaching. Coaching involves active instructional intervention while the student is performing 
a task or solving a problem. Coaching focuses on diagnosis and correction of individual student 
misconceptions. 

Dialogue. In dialogue, the instructor teaches by verbally guiding the student to new insights. 
For distance learning, the dialogue strategy could involve artificial intelligence. The discussion 
highlighted the need for instructor control as well as for student control. 

The discussions initiated a thrust to emphasize strategy selection and the use of alternative 
strategies in distance learning. 

Collective Learning 

Collective learnirig is a pedagogical approach whereby students learn skills individually through 
group work. It is frequently referred to as collaborative learaing. A review of the literature before 
the conference suggested that students ieam better through non-competitive, collaborative grouo 
work than in classrooms that are highly individualized and competitive. 

We examined collective learning at the conference to obtain a consensus that it is a valid and 
desired strategy to use in the distance learning environment and to explore how it can be imple- 
mented. Many distance learners are distant from not only the instructor but also from other stu- 
dents. In the traditional environment, a collective approach often occurs because students form 
unstructured study groups to work together in the learning process. While collective learning 
refers to a formal, struaured instructional strategy, informal opportunities should not be ignored. 

The conclusions of the work sessions did not provide any specific insight on structuring a 
collective learning environment except as an extension to current pedagogical approaches in the 
traditional environment. However, the group did conclude that the value of collective learning in 
the distance learning regime should be pursued with vigor to provide models for developers. 
While traditional instructional strategies focus primarily on instructor^student interactions, 
collective leammg concentrates on the student^student interaction. This modification in the in- 
teraction paradigm changes the control function in the learning environment and needs to be fully 
developed to assure maximum effectiveness. The potential value cf formal collective learning as 
well as the need for informal interaction among students suggests that networking opportunities 
should be available to distance learning. 

Student Performdnce Evaluation 

The issue of when a person has mastered a course or can be certified in a subject matter 
should be a major one in distance learning. In traditional education and training situations, the in- 
structor can directly assess a student's abilities in real time. In distance learning, direct feedback 
situations may not exist. In many anecdotes about people taking distance learning courses, one 
hears about students' mastering the tests without actually understanding the content and about 
cases where people are frustrated by learning the material only to fail the evaluation procedure. 

In response to evaluation scenarios, the small-group discussions reached the following conclu- 
sions: 

1. Evaluation and certification through a distance learning system may or may not be appro- 
priate depending on the subject matter to be tested and on the current state of technology. The 
main concern is for life-threatening operations. 
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2. Evaluation in a distance learning environment can use self-pacing, self-assessment, and 
more flexible scheduling. Evaluation by a distance learning system may become an economic ne- 
cessity in certain situations. 

3. A crucial issue deals with who will be responsible for testing and certification. Distance 
learning evaluation considerations that could affect the quality of distance learning include the 
following: Will those responsible for the actual development of a course be in charge of the final 
certification, or will some authority such as state or federal government take over the responsibil- 
ity? Will course objectives and the testing process be coordinated? How will feedback and in- 
structor^^student interaction be channeled if the certification process is separated from the 
teaching process? 

Note that the major concerns expressed in the conference regarding the student performance 
evaluation problem were not in the construction of evaluation schemes, but in their administration, 
the appropriateness, and the general operation of any possible evaluation system. 

Implementation 

Consensus indicates that distance learning will play a greater role in future education while the 
traditional classroom or schoolhouse approach declines in popularity. Despite this fact, institu- 
tions are amazingly resistant to change and normally do so only when pressured by overwhelming 
external forces. However, on rare occasions, luminaries emerge who have both the foresight and 
the organizational ability to cause and direct dramatic change before the organization experiences 
the woes inflicted by those external forces. 

We need a plan that overcomes obstacles and is so attractive to potential educators and their 
administrative decision makers that they will accept it. With finesse, this acceptance will convince 
educators that they originated the ideas. The challenge is to gain acceptance of distance Inrning 
and acknowledge the major contribution it can make to society. 

Organizational change requires three entities: an identifiable product to which people can re- 
late, proof of accomplishment, and, finally, organizational executive support. 

What we need is a STRATEGIC EDUCATION INITIATIVE- 

This feeling of urgency was at the heart of the group sentiment. In other words, we need a re- 
birth, a vision, a sense of going to the moon. Participants recognized a crisis in education, which is 
not new or unique, but reinforced by the combined experiences of this multifaceted group com- 
prised of education, industry, military, and government representatives. 

Although there is a perceived crisis, it is not considered an emergency. The problem is solv- 
able, and many positive projects are already underway. What is required is a concerted effort to 
bring the resources of the nation to address this problem in a coordinated and focused way. There 
is a call to arms: the need for national-level leadership supported by grassroots efforts across the 
country. 

The top leadership of the country, the president and key members of Congress, are already vo- 
cally supportive. Now is the time to press forward with initiatives and establish a ground swell that 
can capitalize on that hard-earned advantage. 

Distance learning is not a panacea. Future efforts must be coordinated with traditional school 
systems that will continue to be the cornerstone of our basic education in America. The mission is 
to enhance, not compete with, existing institutions. Complementary roles will reduce the fear of 
change while providing for the needs of all sectors of our communities. 
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This conference demonstrated that education, industry, military^ and government can and 
should work together in a cooperative effort to further the cause of distance learning. Implemen- 
tation of the ideas proposed here requires that all participants fully employ the resources available 
to them, which include mobilization of a constituency to gain support at all levels. A steering 
committee will insure that the efforts started here do not die but rather are coordinated and dis- 
seminated to an even broader audience. Each must do his/her part to share ideas and to coordi- 
nate with others so that we can articulate and reach a common goal. Distance learning is part of 
the solution to the education crisis, but it is not the whole solution. We are part of chat solution. 

Conclusions 

Distance learning has the potential to provide an opportunity for lifelong learning, which could 
solve global education problems. Although distance learning can be part of tlie solution to the 
educational crisis, obstacles include resistance to change, traditional views of education, and costs. 
It is crucial that a formal architecture be developed for distance learning in the context of the 
present-day education crisis. 

Implementation of distance learning is a key issue. The successful implementation of distance 
learning depends on several actions. 

■ Document benefits. We must document any existing implementations immediately to expose 
objective evaluations of the advantages of distance learning. Distance learning requires many 
resources and must be supported by convincing evidence that it is, in fact, a viable solution. 

m Evaluate the costs. What are the costs of development and delivery? How can they be met? 

■ Create a cultural change. The expectations engendered by schooihouse teaching traditions 
must be replaced with anticipation of innovation. We must design a new metaphor for edu- 
cation rather than simply implement old ideas with new technology. 

■ Learn from the foreign experience. Distance learning is producing results in many other 
countries right now. We should take advantage of their experience. 

m Locate the control of distance learning. Where should the locus of control reside (in the in- 
structor, in the certifying body, in the local government, or in the federal government)? 

■ Promote a multidimensional constituency. Academia, the military, the government, industry, 
the public schools, and the community must all contribute to the effort to ensure success. 

• Seek national support. It is unlikely that the potential of distance learning will be rea!ized 
without federal support in addition to other (state, city, local, etc.) support. 

We need a plan, a focus, and national leadership immediately. Distance learning can be a part 
of the solution to the education crisis in the U.S. if we can successfully surmount obstacles such as 
resistance to change, traditional views, and costs. The enthusiasm of distance learning proponents 
and the "think ta ik" environment of conferences, like the one sponsored by Los Ala.nos National 
Laboratory, can unify efforts leading to implementation and, perhaps, even effect a national initia- 
tive. 
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DISTANCE LEARNING CONFERENCE PROCEEDINGS 



Compiled by 

John B. Alexander, Andrew E. Andrews, Norman D. Hamer, 
John W. Keller, and Maiy S. Trainor 



ABSTRACT 



This document reflects the content of the Distance Learning Conference spon- 
sored by the Cognitive Systems Engineering Group, Analysis and Assessment Di- 
vision, Los Alamos National Laboratory. The conference participants-highly re- 
spected representatives of military/government, industry, and academia-analyzed 
the potential of distance learning to deal with conunon educational problems. The 
group e^qplored the distance learning problem, media, interactivity, instructional 
strategies, collective learning, student performance evaluation, and implementation 
of a national distance learning strategy. The conferees mandated a national initia- 
tive to implement distance learning in our country. Such a focused effort may help 
alleviate the current global education and training crisis. 
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The Distance Learning Problem 



by Andrew E. Andrews 

Background 

The principal focus was to detennine what must be done to make distance learning a preferred 
solution to educational, military, national, and industrial training/education problems and to de- 
termine howto implement the solution. The participants were challenged to define the prob- 
lem(s), guided by the conference tenet of being requirements driven. 

Assumptions 

We assumed that the participants at the conference were distance learning advocates. There- 
fore, we expected the results to represent an advocacy position. We also assumed that the group 
basically agreed with the distance learning definition shown in the figure below. 




Question 

From the perspectives of education, military, nation, and industry, what are the true problems 
for which distance learning is a solution or requirement? Are there similarities? What should the 
priorities be? Specific examples listed in the paragraphs below are not mutually exclusive. They 
reflect participants' input. 



Education 

This group discussed the unique issues that 
education has with respect to distance learning. 
Highlights of this session are listed below: 

■ Public education is in the news. 

■ The Presidential Education Conference has 
met to air the educational concerns of the 
country. 

■ The military has implemented a great deal 
of distance learning and may have some 
solutions that would be useful to the rest of 
the country. 

■ Adult education at Syracuse University has 
been studied, and many ideas on distance 
learning resulted. 



■ Public relations at the University of the 
World, La Jolla, California, are imple- 
mented with distance learning, which seems 
to be effective. 

■ Many user/human interaction research ac- 
tivities being performed by the military may 
impact the distance learning problem. 

■ PM TRADE (a U.S. Army organization 
and training program manager located in 
Orlando, Florida) is using embedded 
training in many of the research and devel- 
opment (R&D) models currently under de- 
sign. 

■ The U.S. Navy is using distance learning in 
its education and training. 
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■ The instructional systems design (ISD) 
costs for distance learning are high. 

■ Industry is facing a very tough problem in 
r->,cruiting literate workers from the Ameri- 
can popidation. 

■ Recent high-technology developments have 
created unique problems, which may be 
solved using distance learning. 

• Oklahoma State University distance learn- 
ing has demonstrated a large-scale distance 
learning effort for training purposes using 
satellites and closed-circuit TV to reach the 
entire state's National Guard force. This 
effort has just started and looks promising 
as a model for other educational efforts. 

TVe group members agreed thai discovering 
and defining the distance learning problem 
were essential and also agreed to explore how 
distance learning can solve education problems. 
The figure in the final part of this article sum- 
marizes the current problems in education as 
prioritized by this group. 

Military . . 

A number of issues were identified for im- 
plementation of distance learning in the mili- 
tary. Current instructional strategies are in- 
consistent in providing quality training to both 
Active and Reserve components. The instruc- 
tion lacks congruency. A vast array of subject 
matter needs to be taught. Some material is 
applicable to distance learning techniques, and 
some material is not. Many Reservists requu-e 
tiaining, are widely scattered, and have only 
limited time available for training. In the Ac- 
tive Component, a relatively high personnel 
turnover rate exists, which generates the ne- 
cesiity for a continual training effort. 

Large numbers of personnel need to be 
trained. For example, the Army's Training and 
Doctrine Command (TRADOC) alone trains 
450,000 people per year. Managing such a sig- 
nificant program is very difficult. Military units 
are distributed worldwide. Many relevant 
training subjects apply to only a small number 
of personnel at each site. 

Senior management is perceived as being 
slow to accept new ideas as a result of their 
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being educated in a centralized system. The 
services may resist new ideas from outside the 
military. Interoperability among American and 
intema'tional m&itary sei vices is essential, 
which means that individuals must be able to 
cooperate to execute joint missions. In addi- 
tion, dissimilar units must be able to function 
together. 

The services need to standardize many 
functions. However, establishing standards is 
often difficult. Once in place, distance learnmg 
would provide standardized training. 

The group prioritized the issues as reflected 
in the summary at the end of this article. 

Nation ... <• 

This session identified national issues tor 
which distance learning could be a solution. 

The nation needs to be enlightened about 
distance learning technology if it is to fulfill its 
potential. We must be ready to accept new 
concepts of education for distance learning to 
be endorsed and implemented. The lifelong 
learning attitudes of people wiU be changed by 
the concept of distance learning. We are enter- 
ing an age of constant learning and retraining. 

Nationally, we can develop programs and 
new learning communities to educate a larger 
student population more efficiently. New self- 
help communities are already developing in 
some areas and can be expanded. In addition, 
we can t?ip unused resources, such as retired 
people with expertise. 

Di tance learning w'il also permit us to 
emerge from our national shell into a world of 
global knowledge. As a result of our nation's 
developing a global understanding, distance 
learning will be able to reach more people with 
significant issues, such as the worldwide de- 
struction of tne environment. Information con- 
cerning health and social issues, such as AIDS, 
famine, and injustice, can be readily dis- 
seminated. Global distance learning would 
then embrace language and cultural barriers. 

The participant consensus indicated the 
priorities for the nation as shown in the sum- 
mary chart in the final section of this article. 
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Industiy 

This small group was tasked to identify dis- 
tance learning problcnii fclative to industiy. In 
this initiad session, the group had difficulty fo- 
cusing on the priorities for mdustry. However, 
throughout the industry discussion, participants 
agre^ that cost underUes all issues. 

How one motivates or gets others involved 
is a constraint Motivation is fundamental to 
any training, but it is c^>cdalfy critical in the 
distance learning environment. In the corpo- 
rate sector, a **buy in* is essential. 

The standardization of information is im- 
portant For example, management planning 
and procedures, administrative and clerical 
tasks, and common technical procedures can be 
standardized. 

Adequate and thorough training is vital and 
requires the effective use of training resources. 
We must capitalize on the experience of widely 
dispersed experts, instructors, facilitators, and 
certifiers. Auto mechanic training is an exam- 
ple. If the mechanics are perplexed, they can 
consult industry experts. Currently, the 



communication is from ejq)erts to novices 
rather than the reverse. 

Industiy has common training requirements 
that need to be met by a large group of people. 
Distance learning could alleviate the need to 
send many trainees to training centers, and 
could also standardize the content. In cases 
where requirements are common among com- 
panies, a single training system could be avail- 
able to all requiring training. 

The need for training occurs ad hoc and 
usually must be satisfied in a short period of 
time, vet not everyone needs the same amount 
of tramin^ at the same time. It is not necessary 
for new hu-es to wait for the next training class 
when it is being implemented by some form of 
distance learning. Specialized training, re- 
training, and certification can also be accom- 
plished in this manner. 

The issue of continuing education is also 
important to industry. Distance learning can 
provide personal as well as professional, con- 
tinuing education to meet changing 
requirements. 



Summary 

The most significant similarity among the results of all the small-group brainstorming sessions 
and prioritizing tasks was the emphasis on rapid technological cuanges, which have led to changes 
in the labor pool. For example, the military must train mechanics on the newest trucks, but the 
personnel may be transferred to another base where they may need to service old vehicles with 
which they are not familiar. 

A common, significant issue was accountability, making organizations (management) account- 
able for delivering quality training. Other dominant issues were how well facilitators are teaching, 
how appropriate the teaching/training is, and how students are motivated. For example, the Army 
has field exercises for evaluation; they also have teams that evaluate the training and then revise it 
when appropriate. Would distributive learning be feasible? 

The issue of contmuing education was universal. Information dissemination was an issue 
common to the industry, military, and nation groups. Consistency in training was a recurring 
theme. Distance learning implies centralized development and delivery of training, which was 
common to all groups except the nation group. 

How can one deliver consistent, quality teaching? In distance learning, without a teacher 
present, students have more frequent opportunities to interact with each other about the teaching 
than in a conventional classroom. Distance learning requires increased creativity on the part of 
the teacher. 

The language/cultural barrier concern was shared by the nation and industry groups. 

Distance Lctming Conference Proceedings, Fall 1989 5 Los Alamos National Laboratory 



The education group had many issues in common with the industry group, for example, geo* 
graphical and physkal issues, optimization of learning, continuing education, and keeping pace 
with techiiolo*'^ chan^'^es. 



Priorities Established by the Small-Group Sessions 










1 Awareness of distouce 
learning technology 


Motivation 


Quantity and qualify 
of new personnel 


Geographic access to 
education 


Z New concepts of 
imtitutions 


Geographic dispersion, 

non-homogeneous 

population 


Inconsistent 
instructional 
strategies 


Educator training 


3. Lifelong learning 
attitude 


Standardization/ 
consistency 


Rapid tedmolo^cal 
change 


Optimization of 
learning 


4. Global knowledge 


Content 


Global training 
requirements 


Learning continuing 
education skills 


5. Environmental 
issues 


Specialization 


Management 

■ scope of training 

■ turnover 

■ interoperability 

■ cost 


Adaptation to 
rapidly changing 
knowledge 


6. Language/cultural 
barrier 


Effective use of 
training resources 


Interoperability 




7. Information 
dissemination 


Variable (ad hoc) 
training requirements 


Transition from R&D 
to implementation 




8. inclusion of marginal 
members of society 


Continuing education 






9. SrV-help communities 








10. Consensus 


*Cost underiles all 
priorities! 







References 

Note: A binder that was available to conference attendees provided a number of distance learning 
publications. A copy of the bibliography of these publications is provided in the proceedings as a 
resource. 
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Media 



by John W. Keller 



Background 

Tie media session allowed each conference member to make input on media and also pro- 
vided a base from which to progress to the remainder of the conference. Thereafter, when any is- 
sues of media en^.ergcd during the other sessions, we were able to refer to the results of this ses- 
sion. We wanted to prevent ftirther discussions of specific media during other sessions. 

The design of instruction for distance education has been driven by technology. An organiza- 
tion started with its available media and then designed instruction based on them. The issue ad- 
dressed in this conference session was the potentiad of each existing medium for a given type of 
distance learning in terms of instructional strategies. This approadh facilitated the selection of the 
most appropriate medium. The media selected for in-depth discussions were audio/video, print, 
computer-based training (CBT), and synchronous telecommunications. 

Because media should not be the driving factor in the design of a program, we need to decide 
where media belong. We must always ktep the available media in mind while designing an effec- 
tive distance education course. In addition, to select an appropriate medium, we must have infor- 
mation on available media. It might also help if we had an idea of what media will be possible in 
the future and with what types of distance education they will be most compatible. Such knowl- 
edge would help us reduce the temporal gap between technology and its use. 

Our ability to exploit a technology significantly fails to keep pace with the technology itself. 
Software is generally ten years behind the technology it supports. This situation also exists with 
distance education. The technology is advancing so rapidly that the effective uses of the technol- 
ogy for instruction fall behind. How are we to reduce t .e gap between technology and its applica- 
tion for distance education? 

Another factor that we must consider is distribution. All forms of media must be distributed in 
some way. We did not want to debate Aether or not a tekt/ision is its own distribution system. 
Rather, distribution refers to the whole q^stem ' .at is behind the television. Distribution is impor- 
tant because our ability to transmit material is constrained not only by the capacity of the media 
but also by their distribution methods. 



". . . trying to be at the leading edge of technology rather than at the bleeding edge. " 



Assumptions 

■ Media are the backbone of communication in distance learning. 
• Media can influence learning effectiveness. 

« Ultimately, all instructional material must be transmitted in a form that stimulates one or more 
of the senses. 

Questions 

1. Which of the available media are the most effective for distance education? 

2. What new media can be expected in the future? 
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Audio/Video 

The goal here was to determine what 

auuio/viuco media Wcfc available for distance 
learning and ^at would be expected in the fu- 
ture. Althou^ the individual media were ad- 
dressed ocparzidy, it was not»d that is rarely 
the way th^ are employed. Most distance 
learning applications are comprised of several 
different media, which fulfill different require- 
ments within the system* 

Many of the existing technologies do not 
speed interaction. However, controlled inter- 
action might be the most desirable. The quick 
answer is not ahvays the best. If one must mail 
questions, the response time is too slow. The 
quality of the feedback is an important issue. 

While it was determined that each of the 
media was capable of supporting all cognitive 
levels, it was pointed out that in some cases the 



costs would be very high. Tradeoffs in cost and 
effectiveness would need to be evaluated on a 
case by case basis. 

T future work place will demand higher 
cognitwe control of the educational process, 
requiring nonlinear capability so that the stu- 
dent can move freely within the lesson and ad- 
just the level of instruction to his or her q)ecific 
needs. Oearfy, fiilfy integrated technologies 
will be required. Additionally, students will 
need direct access to archived information for 
problem solving and will not be restricted to 
existing lesson formats. 

The following matrix is an elaboration of 
one found in Tnming for Tomorrow (Kearsley 
1985). It lists the m^ia that were discussed 
within the audio/video category. Each cate- 
gory was developed by the participants to show 
the potential for each medium. 




Cat<foi7 



FccdWk& Sciisc{s) Distribution 
Interadioa Used Method 



Cofnitivt Dominant 
Level Cost FMtors 



F\itiire 

Enhancements 



Fdl Production Long Audio/ Synchronous 

Television Video 



All 



Production, 
Distribution, 
Instruct kxul 
Dcd|n(high) 



Search Interactive 
Mode, Index for Non* 
Linear Capability 



AMiWUf* 



Variable 

Student- 
ControUed 



Audio 



Electronic 
Mail 



AU 



Distribution 
(low) 



Audio^phics, 
Global Access, 
Hi|h Motivation 




FWure 



■ Integration of media 

■ Learner aocett to archives 

■ Fiber optic network availability 



■ Location change 

• Non-Iinear presentation 
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Print 

The group defined print as anything that 
can be pmted on paper and stated that printed 
material presupposes some level of reading 
skills. The role of print is to exchange informa- 
tion in an informal dialogue. 

Because of the literacy problems in the 
country today, some graphics capabilities must 
also be included to accommodate marginal 
readers. 

Print has several advantages. It allows for 
the personalization of the material by making 
notes in the margins and by hi^lighting text. 
By mapping the new material into our own cur- 
rent knowledge base, this customization of the 
learning style is a memory aid. Writing down 
information also allows for a gestation period 
and integration at a later time. 

The first issue that emerged concerned the 
distribution methods that print media employ. 
Print is easy to transport or distriTbute to any 
learning or job site. However, this distribution 
method does not allow for evaluation, discus- 
sion, or feedback because mailing questions 
and answers back and forth is too slow. 

Using computers as the distribution 
method is an option. The material can be 
printed out on a printer for those who dislike 
reading text from a video display terminal, and 
interaction can take place faster via E-niail 
(electronic mail). Using facsimile machines 
permits fast transfer of printed material and 
handwritten notes. However, questions of 
honesty and pc*-sonal integrity linger. 

The participants agreed that print will 
probably persist. Future print media will con- 
tinue to be enhanced by computerized in- 
formation storage ard retrieval technology. 



Technology has advanced to the point where 
we may almost dictate our needs and get 
what we want.'' 



Computei^Based Training 

Today's CBT systems have advanced a step 
beyond the electronic page turners, provide 
immediate feedback to the students, and allow 
lor control of the learning process. Modern 



CBT design models are better aule to diagnose 
a student's progress and needs, and they pro- 
mote risk taking because the students ask more 
"dumb** questions of a computer than they do 
human instructors. Intelligent tutoring systems 
are good vehicles for achieving such flexibility. 

Nevertheless, these intelligent systems have 
not really been adopted ye^ Intelligent tutor- 
ing and expert systems do work well for limited 
kno>dedge domains but still are not sufficiently 
general for widespread use. In many cases, the 
instructor must still interact with the student, 
which is especially true in cases where some 
remediation is necessary. Even though these 
systems ideally will stand alone, it is hard to 
envision a system that is designed so well that 
it can handle any question or eventuality that 
might arise. 



'What is (or will be) the function of the hu- ^ 
man being in the fUture of distance learning? 



One component of CRT that was discussed 
k computer control of authoring. A perfor- 
mance content method can be used to con- 
struct CBT. Lesson templates are used, each 
keyed to a particular cognitive function, and 
the teaching is aimed at certain levels of 
mastery or performance. The up-front costs 
are hi^ because the templates must be de- 
signed very well because of the cookie cutter or 
cookbook strategy that this employs. This au- 
thoring tool helps to get a product out quickly 
and cheaply. 

Throughout the discussion, the group 
found it very difficult to deal with CBT as a 
specific media because it encompasses so many 
types of systems. They determined that it is 
not really a medium. The distinction between 
a medium and a distribution method is espe- 
cially difficult to define lor CBT. It is a combi- 
nation of method and media but more than ei- 
ther. The group determined that the term 
computer-mediated training is more appropri- 
ate. This term emphasizes that computers are 
endemic to media/transmission means. 

In the future, CBT systems will do a better 
job of raodeling the student's learning process 
and customizing training to those processes. 
There will be development systems for analysis, 



■erJc 
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design, and implementation of training sys- 
tems. Furthermore, the training will have to 
t^ecome embedded in the ^tem so that it is 
transparent to the learner. Playing and learn- 
ing will become the same thing. 

Synchronous Telecommunications 

A telecommunications medium is syn- 
chronous when there is immediate feedback 
(question followed by answer) to the student. 
These media include, but are not restricted to, 
videoiext, video conference, and computer con- 
ference. This group assumed that its model 
was not limits to instructor and student(s). In 
the case of videotext, t^.e model is computer 
and student. 

In any set of criteria for selecting a 
medium, a cost benefit analysis is necessary. 
Knowing the dominant cost factor Is not 
enough. Especially in the business world, it is 
necessary to assess v/h^i the return on he in- 
vestment will be. Most of the enhancements to 
technology that we discussed involved in- 
creased cost effectiveness. 



Interactivity increases as the medium ap- 
proaches emulating a face-to-face conference. 
Although synchronous telecommunication does 
not permit every element of a true face-to-face 
(lacks the sixth sense) situation, it is a medium 
that allows a high level of interactivity. The 
^oup also determined that two-way audio/ 
video is probably most effective when used in 
the middle- to hi^-cognitive levels, but the 
level of interactivity wlli decrease as the num- 
ber of students and/or sites increases. 



We are still not good at using and managing 
technology for our needs. " 



Under what circumstances is it necessary to 
have this level of interaction? The answer 
given was that it would be any situation in 
which the participants needed to view the same 
dynamic piece of information simultaneously 
or any situation in which the instructor needs 
to interact directly with a student (for example, 
teaching motor skills like ice skating). 



Summary 

Individual media cannot be assessed in isolation. Almost without exception, combinations of 
media are used to create a training system. Therefore, an effective way to address media would be 
to examine combinations of media. Which combinations work the best for given educational re- 
quirements? 

The difference between media and delivery was another issue among all the groups. The dis- 
tinction can be clouded even further by breaking it down into the parts that represent, transmit, or 
produce lesson material. Although no one group developed a clear insight or proposed a specific 
resolution, the participants generally agreed that this problem warrants and requires further inves- 
tigation. 

A greater level of learner control was also a common theme. Students should be able to con- 
trol the level of interactivity and the educational process to meet their needs. A large and growing 
amount of archived material is available, and the learner must be able to access and retrieve some 
of this material. Fully integrated technologies will be required for these needs to be fulfilled. 

We tend to apply technology to the things we have always done in the past, simply using a new 
tool m an old way. New strategies must emerge that effectively use the new technologies. For ex- 
ample, in what ways can these strategies be used to achieve more effective instruction using the 
higher levels of Bloom's taxonomy? 

Reference 

Kcarslcy, Greg. Traimngfor Tomorrow (Addison-Wcslcy Publishing Company, Inc., Reading, Massachusetts, 1985), p. 106. 
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Interactivity 

by Andrew £. Andrews 

General Overview for the Next Three Sessions 

The next three sessions dealt with motivating students to learn. In any instructional envi- 
ronmentf uudents a;e motivated for a variety of reasons, which can be categorized in two ways. 
First, minimal performance expectations are linked to students' personal goals. For example, 
meeting a specified level of training may be required to meet job qualifications. In a sense, these 
motivators are a form of negative leadership: perform or else! Generally, these forms of motiva- 
tion are easily established, but they guarantee only a minimal level of performance. 

The second set of motivators stimulates students to excel. Usually, these motivators are in- 
tangible and often reflect the leadership of an outstanding teacher. However, distance learning 
reduces instructor contact. Instead, the medium for communication tends to be impersonal, at 
least on the surface. Yet, if distance learning is to be universally successful in contributing to a 
better-educated and more-capable population, it must stimulate higher student achievement. 

In the sessions that followed, the conference addressed the three areas that have the greatest 
potential for positive motivation-interactivity, instructional strategies, and collective learning. In 
^11 of these discussions, the participants were asked to concentrate on the metaidea of positive mo- 
tivation for the learner. 

Background 

Learning requires interactivity. The learner must accept the information provided, process it; 
and internalize it. Furthermore, the instructor requires feedback from the student to adjust in- 
structional strategies, apply remediation, and respond with enco* lagement that is intrinsically mo* 
tivating. In the distance learning environment, print, audio, graphics, and video are available tech- 
nical tools. Through various communication systems, students and instructors and students and 
students can converse. Also, students interact with the instructional content; sometimes the in- 
structor is a machine. The issue is to establish standards for interactivity, guidelines for achieving 
it, and requisite skills for distance learning faculty with respect to interactivity. 

[Note that inculcating a desire for lifelong learning was not discussed This subject, perhaps with- 
out consideration of interactivity, needs to be addressed and will be a topic in a future distance learning 
conference with the more restricted view of determining if distance learning can provide the motivation 
for lifelong learning] 



What level of motivation (hov^ much intrin* 
sic motivation through interaction) is dis- 
tance learning obligated to provide? 

The group had difficulty with the notion 
that distance learning should be intrinsically 
motivating. They questioned the assumption 
that interactivity provides motivation. Ac- 
cordingly, they restated the question to ask 
what type of motivation distance learning is 
obligated to provide. 



"We dont do a lot of training because it's fun 
to do or take a job that doesn V pay. " 



The following guidelines represent their 
solution to the challenge of motivating distance 
learners. 

■ Get*em there. 

■ Keep'em there. 

■ Get'em to come back. 

They characterized students in the next 
chart. 



^ Distance Learning Conference Proceedings, Fall 19o9 11 Los Alamos National Laboratory 



ERIC 21 




Intrinsic and extrinsic motivation must be 
differentiated. We should examine the charac- 
teristics of motivated learners (age, relevance 
of material, cultural history, language, interest 
level of material, and control of learning sit- 
uation). Finally, they identified the loUcwing 
principles for motivation that should be con- 
sidered in distance learning. 




The group also felt thai instructors reed 
motivation. One group member pointed out 
that the instructor has the responsibility to cre- 
ate an environment that encourages learning. 



What are the guidelines for interactivity 
and/or how should they be established? 

This group wrestled with the task of identi- 
fying guidelines for interactivity in distance 
learning and/or how to establish them. The 
discussion focused on identification but did not 
formulate conclusive guidelines. Nevertheless, 
some insiglitfid observations are listed below: 

1. Good practice suggests moving toward 
intrinsic motivation. 

2. If the student is allowed to select the 
level of interaction, guidelines for interactivity 
may not necessary. (Note that the difficulty 
of permittinf each student to select his/her 
level of interactivity was not discussed.) 

3. Options must be incorporated that rec- 
ognize different learning styles. 

4. Distance learning slows down the inter- 
action enough to promote a higher level of in- 
teraction from reflective learners. 

5. In the future, cost, benefits, and fidelity 
levels must be considered. 

Additionally, the group looked at interac- 
tion with respect to Moore's model of interac- 
tivity (Moore 1989). They suggested a pro- 
gressive series of questions: 

■ Is leamer<^conJent enough? 

• If not, is learner*->instructor needed? 

■ If that interaction is still not enough, how 
about leamer^leamer? 

The level of interaction can be increased as 
needed if at some point leamer^^content in- 
teraction fails and the performance suffers. 



What could be some guidelines for achieving 
interactivity through primary media? 

The discussion in this group centered on 
two areas that we can roughly term as media- 
affected interactivity and environment-affected 
interactivity. 
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Under the umbrella of media*affected In- 
teractivity, we include concepts that deal di- 
rectly with the hard presentation of the IcBrn- 
ing system: course structure, video presen- 
tation, scripting, etc. All agreed that good de- 
sign was extremely critical. Design can com- 
pensate for many hardware limitations, but un- 
limited hardware and production will have little 
effectiveness if the overall design is poor. 
Knowing the audience is aitical in distance 
learning. One should avoid obvious blunders 
such as cultural taboos and meaningless analo- 
gies. In addition, every effort should be made 
to involve students in cour/^ from the start. 
Caution should be exercised to eliminate tech- 
nology anxiety if the course is using the latest 
methodologies. 

It is also helpful to make the lesson mate- 
rial nonjudgmental Early success reinforces 
and encourages students to persevere and seek 
further education. 

Whatever the media, proper care in devel- 
oping a "good story" with drama and suspense 
can do much to integrate the student and com- 
pensate for not having the latest hardware. 
Further, the greatest technology can never 
overcome a poorly planned and scripted 
course. Video presentations must he compa- 
rable to those seen on commercial television 
because people have come to expect such a 
production and are disappointed by anything 
less, which does not mean that the video screen 
should be cluttered with details and minute re- 
alism. On the contrary, if a screen is too busy 
attempting to achieve lifelike fidelity, it can be 
distracting. 

Presentations should be kept as simple as 
possible to avoid distracting cognitive overload. 
Creative design can create the illusion of real- 
ity without the expense or overload of a full- 
blown simulation. Simplicity and good design 
should be the standards. 

Regarding the second type of motivation 
mentioned above, we refer more to an at- 
mosphere or attitude rather than to the tech- 
nology that we have just discussed. Here we 
consider that motivation and extrinsic rewards 
create greater interactivity and learning. The 
group noted that motivation and interactivity 



have a circular relationship of induced rein- 
forcement. 

Fostering a sense of community within the 
students generates a great deal of interactivity. 
Course material development can create such 
teamwork and interdi^ndence among the 
students. It is important to make each student 
feel a re^nsibility to the group, that is, that 
they are needed and must support the success 
of the group. The sense of community and 
bonding among students will encourage in- 
creased effort by each student. In addition, in- 
structor feedback will always be important to 
the atmosphere provided. 

What are the requisite skills for distance 
learning faculty with respect to interactiv- 
ity? 

Faculty skills include those used by in- 
structors, designers, content experts, tutors, fa- 
cilitators, proctors, and supervisors. Anytime 
the term instructor is used, it refers to the per- 
son that delivers the actual material by a 
medium that supports this delivery method. 

There are also several types of interaction: 
student^materlal, student^instnictor, and 
student^student. Generally, we are con- 
cerned with the interaction between the stu- 
dent and the instructor. 

For the most part, it seems that the re- 
quirements for good distance learning faculty 
are an enhanced version of the skills found in 
good instructors from traditional learning plus 
some media-^>ecific requirements. Some cre- 
ativity is required because the planning and 
management of distance education need to be 
better than those that are generally found in 
traditional formats. It will not be sufHcient to 
have instructors that can just "tap dance 
through the material." 

Faculty must be able to deal with the lack 
of feedback from students. Teachers are accus- 
tomed to using student f<:edback to motivate 
them and to enhance instruction. Distance ed- 
ucators may have to learn to Hve without these 
incentives. Faculty may have to be able to 
teach the students how to learn effectively, 
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u«ing the new environment of distance educa- 
tion. Many media-specific requirements will 
also be needed. The faculty must deal with 
new student learning strategies throu^ differ- 
ent media. For example, in various oiltural re* 
gions of Alaska, students have learned differ- 
ent ways to i^espond to questions. In one area, 
they have been taught to think about their an- 
swers carefulfy before re^nding* In another, 
students reply immediately even if they do not 
have a well-considered answer. An instructor 
using two-way audio needs to be able to deal 



with complete silence across the line while stu- 
dents think about answers. 

When using both audio and video, it is 
common for inexperienced instructors to ne* 
gleet the remote learners. The instructor must 
know how to encourage interaction from the 
remote group. ^Tien using two-way audio, ad- 
ditional listening skills are required because of 
the lack of visual clues. In many cases, faculty 
must be able to communicate effectively 
through written material. 



Summary 

In the ensuing large-group discussion, there was a distinct focus on interactivity and media. 
With the caveat that distance learning should/can be entertaining but should not be entertain- 
ment, participants agreed that much can be learned from commercial television, the cinema, and 
the advertising community with respect to interactivity. Furthermore, we should not be sf mply 
trying to duplicate the traditional classroom. We must leverage the technology to do what it does 
best. 

Good course design is critical and can offset hardware limitations. Distance learning forces us 
to return to design and determine how we can improve on what we have in place. The best tech- 
nology can never compensate for a poorly planned and scripted course. Because technology has 
advanced to the point where we may almost dictate our needs and get what we want, instructional 
material must oe sensitive to the times. For ctirrent technology to enhance and encourage distance 
learning, the courses must be interesting and well planned. 

A fine line exists between entertainment value and educational value of the media. Therefore, 
instructors must know their audiences. Learning materials must have exciting, stimulating, enter- 
taining, and charismatic elements, but they must also be relevant to the knowledge domain. Madi- 
son Avenue and commercial television can teach us a great deal, but we must not lose sight of our 
educational objectives. On the other hand, instructors must create some excitement or they will 
fail on television/video. 

We focused on instructors, noting that simply giving instructors more to do or expecting them 
to acquire a greater inventory of skills will not work. Distance learning requires a faculty team, 
forcing a return to design and an assessment of how technology can help improve instruction. 
However, we must not let technology drive the course. 

Student-to-student interaction is crucial to good learning, and we also focused on interactions 
between the students and the instructor. Faculty must be able to deal with lack of feedback from 
students. Teachers are accustomed to capitalizing on student feedback to guide their instruction 
or to internalize feedback for their own motivation. 

Positive interactivity can be generated by developing a sense of community among the stu- 
dents. One strategy for encouraging interactivity is to develop course material to support team- 
work and interdependence among the students. Each student must feel a responsibility to the 
group-a feeling of being needed and Mng essential to the success of the group. Such a sen^e of 
community and bonding among students will foster more concerted effort by each student. 
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learning. Motivation and interactivity have a circular reinforcement relationship for both the in- 
structors and the students. 



'Try to make knowledge interesting. It is the cwrency of our f^mes. " 



One must consider the backgrounds of the students. Cognitive style (external versus internal 
locus of control and reflective versus impulsive) is very important and not linked to autonomy. In 
traditional classrooms, impulsive thinkers are rewarded. In a distance education environment, re- 
flective thinkers can interact at a higher level because interactions are slowed down enough for 
them. Some learning-disabled st>!dents can tolerate onfy a nonstructured environment, yet others 
cannot. Distance learning may demand a greater amount of adaptability than conventional in- 
struction, and this adaptability will be essential because courseware has to accommodate all types 
of thinking. 

Motivation is inherent in interactivity. Characteristics that motivate people, both young and 
old, need to be identified. Motivating the teacher as well as students is a critical issue; thus, if the 
teacher can be motivated, student motivation logically follows. Early student success is critical to 
reinforcement, committing the student to a class and motivating the student to seek further success 
in education. Students' enthusiasm for the course material, in turn, motivates the instructor. 
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Instructional Strategies 



by Mary S, Trainer 

Background 

Interactivity guidelines set the stage for a course, but one must determine the pedagogical ap- 
proach or instructional strategy for applying these guidelines to the design. Many different tax- 
onomies for such strategies exist in the education literature, but these taxonomies cover the same 
content. The strategies range from expository (lecture) to tutorial (present information and then 
ask questions) to simulation and Soaatic dialogue. The level of interactivity in these strategies 
varies in quality and frequency of interactivity. Most courses of instruction use several in- 
structional strategies to meet the needs of the students and the subject matter. 

This session explored alternative distance learning instructional strategies^ with the goal of in- 
creasing the potential for learning effectiveness. The taxonomy for instruaional .^^trategies selected 
for the conference is below. These strategies are presented in sequence from the le^st interactive 
to the most interactive. 



Instructional Strategies — 

A Range of Choices for Distance Learning 

Lecture: The one-way presentation of information from an instructor to students. 

Drill and Practice: Exercises to ensure incorporation of facts and procedurei 

Tutorial: Material presented and questions asked 

Games: Ary contest armmgadmsariesopemtingumierndesfof' an obje 
f^iPtiyoff). The adversa^mc^ be a computer or another person. . ^ _ n*^ ' k^: 

Simulation: A working modd (imitation) of the targeted system g^en0 the studertt to 
manipulate and observe. TJtis rnodel nuiy be physical, ptrKedural, situational, or 
process in ruUure. Laming occurs by performing activities in a corUext^mU^ • -i^ 

the real world , ^ 



Coadilng: Irtstructionaiiraervendon given whUe a student is perform 



: ^ i^^-^jptoblem. The intervention is specific to the type of error the stu4mt Hff^^^ad^ ^^^^^^f 

pialc^pe: Questions for (he studerU by a human or a conqmter. JXalogut^^f^^ 
' tailored feedba^ 
student's response. Some inteUigenttutoritig systems are examples of coriy^^ 
dialogues. '-^ 

Collective Learning: A process or situation in which students cooperate in coloring a given 
area of study or in solving a problem. 



The potential for analysis and synthesis learning experiei ces is higher in the dialogue strategy 
than it is in the drill and practice strategy. Obviously, this is a broad generalization for which many 
counter examples can be made, but it is a useful paradigm for planning curricula. At the beginning 
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of a new module during which new knowledge must be acquired, exposition and driU and practice 
might be good initial strategics, followed by simulation and then collective learning exercises Di- 
fartS^pr^^J^^ strategies, for example, are not optimal strategics for presenting new 

Several instructional strategies have not been used to any great extent in distance learning. 
Kec:?u5e jiew advances m technology, these strategies (for example, games and simulation) can 
now be used. As a result of extensive educational research, educators have capitalized on video 
?n?o^ W^^^ example, Ellington et al. 1981; Malone 1980; and Nawrocki and Winner 

1983). This research has revealed the design challenges required to make a game both motivating 
and mstnictionaL Distance learning presents new chaUenges for the instructor/designer when se- 
-cct|ngmstructional strategies. Therefore, the distance learning community needs to provide 
guidehnes for selecting and using instructional strategies, in particular, those that have not been 
adequately exploited. 

Rationale 

Traditionally, litUe emphasis has been placed on distance learning instructional strategies In- 
stead, the medium is selected, and then the instruction is written, based on the capabilities of the 
medium. The focus has been on technology at the expense of instructional strategies. This ap- 
proach can produce the following undesirable results: 

■ Unmet training requirements, 

■ Cognitive-level mismatch, 

• Use of instructional strategies not compatible with student requirements, or 

■ Lack of variety in media used for a course. 

FrequenUy, an instructor fixates on one successful and familiar instructional strategy, but that 
P not be the best match for the student population, the subject matter, or the 

course objectives. This situation can resuh in unmotivated students and/or students who complete 
the course, havmg achieved different objectives than those expected. 



Alternative Strategies 

At the conference, the instructional strat- 
egy question for small groups focused on in- 
depth development of individual strategies that 
have been unexploited in distance learning. 
The strategies explored were games, simula- 
tion, coaching, and dialogue. 

Games 

A game is any contest among adversaries 
operating under rules for an objective (for ex- 
ample, winning or payoff). The adversary may 
be a computer, the student himself/herself, or 
another person. Games are versatile instruc- 
tional strategies that stimulate high-cognitive- 
level learning. 



"Games are versatile instructional strategies 
that stimulate high-cognitive-level learning. " 



The discussion explored many of the posi- 
tive and negative aspects of games as an in- 
structional strategy. Positive attributes in- 
cluded the following aspects: 

■ Games are a good technique to develop 
learner involvement and/or collaboration 
(for students at different sites). Tney pro- 
mote good learner control. 

■ Their effectiveness depends on the target 
population and individual personalities. 
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Hjcv can be designed to be collaborative 
and goal-oriented, rather than adversarial 

Games pre appropriate for computer-based 
approaches and distance learning because 
the presence of an instructor is usually not 
essential. They mediate the absence of 
resident instructors. 

Tht^ can be used in virtually any content 
area. 

Games are appropriate for autonomous 
learning environments. 

Games provide closure. Students know 
when they are done. 

Games can energize any subject. 



"Games can turn the dullest subject into one 
of excitement. " 

They offer an opportunity for collaborative 
learning. If instructional games were im- 
plemented in distance learning, unresolved is- 
sues would include the following concerns: 

. How can one define competence in the 
subject matter? Completion alone is 
probably inadequate. 

■ Designing good games is difficult, and 
building good Instructional games is even 
more difficult. 

. Not all students are interested in competi- 
tion, so some students may not be mou- 
vated by games. 

• A game must be used in the context of the 
entire curriculum, with its usefulness 
judged by the results produced. (Using a 
game as its own end is not defensible in the 
learning environment.) 

. The possibility of students' just trying to 
beat the game and not trying to learn the 
subject must be considered in design. 

"If time and resources were unlimited, we 
could simulate anything. " 



Simulation . , ^ 

In a simulation, a student manipulates a 
working model of the system being studied. ^ 
Some simulations present a scenario io whicu 
the student responds, others requu-e the stu- 
dent to set up the scenario and observe the re- 
sults, and others require students to perform in 
a rolei>laying manner. Until recently, simula- 
tion as an instructional strategy has rarely been 
used because of cost limitations. Now, with the 
advent of simulation-based training experi- 
ences, it is a feasible strategy (Reigeluth and 
Schwartz 19S9). 

The group discussed the range of simula- 
tions from simple visualization to role-playing 
decision making. When using a simulation 
strategy, an instructor's role changes to that ot 
a faciHtator. Discussion on simulation revealed 
this strategy as a means to an end, not the end 
itself. Optimal situations for simulations iden- 
tified were the following: 

■ Safety is a concern. 

. The consequences of inadequate training 
are costly. 

. Specific, tailored feedback is needed. 

. Multiple and synci.ionous activities occur 
in task performance. 

■ Time is limited. 

. Expanding beyond the instructor's experi- 
ences is essential. 

The discussion centered around mst and 
feasibUity issues. TTie consensus was that sim- 
ulations are exceUent instructional tools that 
stimulate higher-level thinking. However, the 
cost is a concern. Few low-cost simulations ex- 
ist. 

One concern emerged regarding imple- 
mentation: Simulations are often designed tor 
instruction but used for testing. Evaluation sti- 
fles exploration on the part of the student; 
learning occurs through exploration. 
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Coaching 

Cog. hing involves active instructional in- 
terv^tion ^^en the student pefforms a task cr 
solves a proUem. Interaction must take place 
between the coach and the student. The coach 
gives individual attention and feedback as 
needed Feedback indudes evaluation and 
demonstration of a{^ropriate performance. 
Fe^back may or may not be in real time. 
Videotaping a learning activity can easily ac- 
company distance learning. It allows one to 
study that activity so that performance can be 
analyzed and necessary corrections can be 
made. 

The question of when to intervene is per- 
tinent to coaching both in person and from a 
distance. However, the answer may be more 
elusive in distance learning because many of 
the cues that are availaUe in person will be 
missuig in a distance learning settings even with 
very sophisticated audio/video systems. This 
situation raises the question of coaching strate- 
gies in general. Can it be assumed that what 
works in person will work from a distance? 
Such may be the case, but clearly some analysis 
of different coaching strategies will be neces- 
sary. 

In the typical classroom environment, 
coaching is not feasible because of the large 
number of students. The focus of coaching is 
diagnosis and correction of individual students' 
misconceptions. In the distance learning 
environment, coaching is possible through the 
use of telecommunications and through intelli- 
gent tutoring systems. 

The discussion of coaching concentrated on 
describing possible different coaching systems: 

■ An AI system could learn, log students' 
performances, and make decisions con- 
cerning students' programs at various 
stages. 

■ If the coaching option were programmed 
into a system, the learner could control the 
level of intervention desired. 

■ The language laboratory model for coach- 
ing is still a useful one. 



■ Videotaping can be a powerful tool for a 
coach in live performance training (for ex- 
ample, sales). 

« 

■ Coaching is equally appropriate for athletic 
and academic skills. 

The group highlighted the difference be- 
tween coadiing and evaluation. Coaching pro- 
vides correction right after being informed that 
an answer or action is right or wrong. Evalua- 
tion simply indicates than an answer or action 
is right or wrong. 



7/1 noninstructor coaching, simulation ap- 
pears to be a necessary requirement. " 



The subject matter here is more critical 
than in some of the other strategies. For ex- 
ample, immediate coaching feedback in a 
speech class would be potentially destructive. 
Specific coaching examples included computer 
intervention durmg a simulation exercise or af- 
ter a system locks up following an incorrect re- 
sponse during a nudear reactor simulation. 

Dialogue 

Dialogue, like coaching, is a strategy that is 
not feasible in a classroom situation but, with 
the appropriate technology, can become feasi- 
ble. It requires a one-on-one teacher-to-stu- 
dent ratio. The only existmg models for the 
computerized dialogue strategy come from the 
world of intelligent tutoring systems. In dia- 
logue, the instructor teaches by guiding the 
student in conversation to discover new in- 
sights into the subject matter. Unlike coaching, 
dialogue can take place in the absence of task 
performance or problem solving. 



"Dialogue makes distance learning more ef- 
fective by focusing andfunneling the infor- 
mation. ** 



In the small-group discussion, the prevail- 
ing opinion was that some learner control must 
be involved in useful or informative dialogue- 
based instruction. Student questions to their 
peers and instructors should be allowed. 

Dialogue allows active involvement of the 
student as well as individualization of the 
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learning environment Dialogue also provides 
feedbadc to the teacher, whidi enables him/ 
her to develop a model of the student. To ' 
implement dialogue for a group, the strategy 
needs to include the capability for each student 
to be involved, which is possible through shift- 
ing leadership. 

The group reached the foU^iving conclu- 
sions: 



■ Dialogue can help negotiate the meaning 

that fhft instrnrtnr ic tn/inw tt\ t^nt%\tA%t 

m Dialogue manages instruction and allows 
flexibility and prescriptive, individualized 
instruction. 

■ Dialogue helps instruct the teacher and can 
make a model of the student. 



Summary 

The instructional strategies topic generated many new ideas for implementing alternative ap- 
proaches in distance learning. Regardless of subject matter, all four strategies discussed were con- 
sidered to be useful components of a curriculum. 

TTie computer played a central role in the delivery of each of these strategies in the distance 
learning environment. The ejpense of the computer software implementation could range from 
veiy low (bulletin board) to high (intelligent tutoring systems). However, low-cost implementation 
of alternative strategies is now possible. The dearth of models in the literature and software on 
the market has caused the lack of implementation thus far, but such models are now rapidly 
emerging. 
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Collective Learning 

— ' ' by Andrew E. Andrews 

^"'^iffie the other sessions of the conference, the coUective learning session concentrated on a 
subject that was more narrow in scope and more focused on innovations. The mtent was to ad- 
vance the field through the synergistic input of experts. 

I The expression collective learning stems from the military term collective training, but each has 

, different goals. CoUective training prepares a team to work together in a realistic problem situa- 

!• tion whereas coUective learning develops the knowledge, skills, and/or abdities of an individual 

through group work. The Uterature contains several recent studies on coUaborative learning, pri- 
marUy in English classes. CoUaborative learning can be viewed as a subset of coUective learning, 
with the same goals. 

UniversaUy, instruction must provide a high degree of transfer of knowledge and skUls to the 
student, either in the work environment or the education setting. Technolosr and the "^formation 
explosion have markedly increased cognitive demands on employees aid students alike. WhUe 
these chaUenges are complex, the changes further compUcate the situation. The requirements of 
many jobs have changed from task performance to monitoring complex tasks and teipromptu 
problem solving. Moreover, our traditional modes of instruction have not proved highly ettective 
to satisfy these requirements. 

"By challenging the traditional view of the teacher's authority, collaborative learning helps pre- 
pare students for effective interdependence in a n increasingly collaborative world. ...k.a. Bmffet 

A recent approach, which we wUl classify as an instructional strategy here, is collective learn- 
ing, the pedagogical approach in which students learn skUls individuaUy through a group ettort. 
For example, they may jointly solve a problem, perform a case study, or research a situation and 
write a report on it. 

Dr. Michael Moore of Pennsylvania State University addressed the need for additional focus 
on the student**student interaction component of distance learning (Moore 1989). In the past, 
the focui has been on student«instructor and student«subject matter. Unfortunately, the dis- 
tance learning proponents need more than a mere suggestion to implement such a strategy, in^ 
need specific guidelines concerning student**student interaction (where, how, when, and whyj. A 
goal of this session was to develop such guidelines. 

Assumptions • i j ■ t* 

. CoUective learning requires careful planning by the instructor or mstructional designer, it 
cannot be highly effective as a casual, student-determined strategy. 

a CoUective learning can stimulate work place communication. 

I . CoUective learning provides some students more effective feedback than is avaUable in tradi- 

^ tional settings. 



How should collective learning be structured? solving must be addressed. All participants 

(instructors, students, and course designers) 
Organization. The differences between must have a set of prerequisites and a common 

coUective learning and coUective problem frame of reference from which to work. 
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In the training environment today, people 
are working as individuals, yet most complex 
problems are group problems. To meet the 
existing needs, training must adapt to the col* 
lective learning group's mode of addressing 
problems. Therefore, it is important to con- 
sider this imj^lied constraint on the organiza- 
tion of collective learning. 

A debate persists in the U.S Army about 
whether collective learning is learning or is an 
experience. No assessment measures exist to 
settle the issue. For example, the National 
Tiair^ing Center (Fort Irwin, CA) has no way 
to replay a battle and then let units learn to 
improve their strategies. 

Nevertheless, the military uses the field 
training exercise (FTX) as a collective learning 
tool. Actually, it is a good example of inte- 
grated collective learning and distance learn- 
ing. Even if there are no predetermined cor- 
rect methods to evaluate a unit's performance, 
the FTX usually is a vehicle to build a better 
unit, a demon*j*ration of effective collective 
learning. 

In collective learning, the emphasis is on 
the learning that an individual must acquire to 
function in a generic position. There are two 
types of collective learning. In the first, spe- 
cific objectives are defmed, and training is 
conducted, guided by these goals. In the sec- 
ond, no concrete goals exist; learning occurs 
because of exploration of the subject material 
and interactions among students. 

Synchronous and asynchronous modes of 
collective learning are different. In syn- 
chronous collective learning, time limits may 
be used to put more demands on the students, 
forcing the students to meet the instructional 
objectives in a timely manner. Synchronous 
collective learning is a good approach when 
pressure on students is needed. 

For collective learning, one must consider 
three evaluation levels: the individual, his 
manager, and the manager's manager. Ques- 
tions and performance evaluation must be 
derived from the perspective of all three levels, 
helping management's vested interest and pro- 
viding a healthier collective learning ' nviron- 
ment. 



In collective learning, distinct standards are 
needed for both the individuals and for the 
group. The goal is to have the students acquire 
all the individual skills and to make the transi- 
tion to a learning mode that primarily meets 
the group objectives. Often textbook solutions 
are not available for the group problems, so 
many different learning approaches may be 
appropriate. When writing learning objectives, 
instructors should allow for flexible guidelines. 
To illustrate this point, they could provide 
open-ended problems for training exercises. 

The sirucJure of collective learning and dis- 
tance learning must be guided by function or 
requirements. When the collective learning 
format is being used to teach individual skills, 
we use the same measures that traditional 
teaching uses to evaluate. When team skills 
are being taught, new evaluation strategies may 
need to be developed. 

Collective learning structure is different 
from that of traditional learning and varies 
with the students' diverse backgrounds and the 
subject matter. Objective performance evalua- 
tion measurements must be developed, re- 
gardless of the learning objectives or any dif- 
ferences from traditional learning environ- 
ments. 

*Wlien is it collective learning and w.ien is it 
collective problem solving.^" 

Troubleshooting Is an example of an inter- 
esting collective learning environment. For ex- 
ample, the specific goals for learning to trou- 
bleshoot a given type of equipment are impor- 
tant. However, accumulating a bag of trou- 
bleshooting tricks is also crucial to the transi- 
tion from the novice to the expert level. Col- 
lective learning allows students to find out 
about other students' "bags of tricks" as they 
work together. 

If the environment is hazardous, it is very 
important to control the organization of the in- 
struction, and risks and consequences must be 
considered in instructional design. 

The delivery system must be considered 
when planning training, but it must not drive 
the total effort. The learning objectives must 
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be the drivers. One must take advantage of the 
strengths of technology and use benchmarks to 
guide the type and amount of feedback. 

Techniques for effectively managing multi- 
ple dialo|;ues that may occur in collective 
learning m the distance learning environment 
must be developed. Dealingwith the frustra- 
tion induced when the network goes down or 
the local system fails must be addressed to re- 
duce dropouts. 

The collective learning designers must also 
consider the group size. Depending upon the 
task, a group size of two to eight appears to be 
optimal. 

The composition of the group is an inipor- 
tant factor. One must be aware oa when it is 
possible to combine diverse people in a collec- 
tive learning environment. 

The success of a collective learning situa- 
tion is dependent on the availability of instruc- 
tors. In addition, the student body may not 
remain stable. Designing effective learning 
around changing personnel is indeed challeng- 
ing. 

Because of the time demands on managers 
in particular, the length of the course is impor- 
tant. Distance learning can allow a one-week 
collective learning-based course to be spread 
out over a month, allowing the manager to take 
care of daily business demands. The time in a 
learning session should not be too short. Three 
to four hours seem reasonable for a collective 
learning management session in the distance 
learning context. 



'The instructor's authority is changed, not re- 
duced*" 



Instructor Role. The group felt strongly 
that the role of the instructor will not vanish 
but must change. The instructor must commu- 
nicate the course objectives to the students and 
also must be able to adapt rapidly to changing 
learning situations and unexpected student re- 
sponses. He/she must also recognize when 
students are operating at different levels and 
intervene to fulfill the learning objectives. 



The instructor must judge whether the stu- 
dents' behavior has changed in a positive way. 
Has 

tion places more demands on the instructor. 
The mstructor^s authority will not be reduced; 
it will be changed by both collective learning 
and distance learning. The instructor will have 
to operate at a different level than in a tradi- 
tional learning setting. Alert instructors can 
indeed moderate group dynamics and group 
behavior in a distance learning setting, but it is 
a challenging situation. 

The instructor must be more versatile than 
in,a traditional classroom in terms of pre- 
sentation of material and real-time reaction to 
the students' learning modes. The instructor's 
analysis, group management skills, and subject 
matter expertise will also be more important in 
coUective learning contexts. Depending on 
course design, lesson preparation may be more 
intense and thorough than for a traditional 
classroom. 

An assertive student may pose problems in 
a collective learning situation, and instructors 
must handle situations so that such students do 
not cause the course objectives to be compro- 
mised. Although groups can compete against 
each other, the role of the instructor must be to 
encourage cooperation rather than competition 
among the students In the real world, cooper- 
ation gets the job done. 

In the military, personal integrity is crucial. 
Leaders guide units that must follow mission- 
type orders. The collective learning situation 
allows integrity to be explored through the way 
that the group solves problems, and the instruc- 
tor must carefully evaluate this aspect. The 
discussion group asserted that in coUective 
learning there is no book solution. The instruc- 
tor judges the solution and p/ovides feedback 
to the students. 

Student Issues. Collective learning imi- 
tates reality. Because of the myriad of poten- 
tial disasters that can occur in real life, solving 
problems may greatly improve the secondary 
skills of students, which may ultimately be 
more important. 

Asynchronous distance learning allows reti- 
cent people to have time to contemplate their 
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answers without being preempted by the as- 
sertive students. Furthermore, both asyn- 

cftronous snc? 

develop team skills that arc useful in other ca- 
reer aspects. These skilk may have much 
greater importance than tne short-range skills 
derived directly from the priraary learning ob- 
jectives. Collective learning increases motiva- 
tion and may decrease the dropout rate that is 
characteristic of traditional conre^ndence 
courses. More training for a given cost will re- 
sult. 

Loners must be motivated to be team 
members. Collective leamirg provides a ve- 
hicle to break down the barriers of individuals 
to be team members. When groups of people 
work together in collective learning, individuals 
will be motivated. Furthermore, individuals 
are challenged to prepare for the learning ses- 
sion to avoid appointing the group. 

Individualized distance learning creates 
learner loneliness. Collective learning may 
help ease this loneliness by allowing students to 
interact. In traditional correspondence 
courses, students must be very self-disciplined. 
Collective learning can compensate for a lack 
of personal discipline. Collective learning can 
build enduring friendships, which can be re- 
newed throu^ additional collective learning 
experiences. This opportunity to build such 
friendships alleviates the loneliness of the 
learner. 



"Distance learning implies the loneliness of 
the learner. Collective learning reduces the 
loneliness and motivates students to relate to 
each other and to the world " 



What are the desired characteristics of appro- 
priate tasks that students can perform collec- 
tively at a distance? 

Small-group discussion identiHed optimal 
characteristics of tasks that students can per- 
form collectively at a distance: 

■ The objective must be clear. 

■ The problem mu:>t be challenging. 



■ The task must be reasonable in terms of 
time, sk'Us, and physical resources. 

■ Specific roles must be assigned. 

■ A balance between structure and dialogue 
must be possible. 

o Closure mu^l occur to solve a problem co- 
operatively, to build results together, and to 
review feedback across the system. (How- 
ever, how does the instructor know that 
students have finished? Is closure a 
separate issue?) 

Collective learning works, and there is no 
difference between tasks in traditional and dis- 
tance education with respect to desired charac- 
teristics. 

Two different types of groups are involved 
in collective learning. For example, in law 
school, study groups form spontaneously to 
meet common goals. In other settings, partici- 
pants may be assigned to projects by a teacher. 
Evidence indicates that randomized grouping 
does work. 

In addition, a balance between structure 
and dialogue is necessary to facilitate commu- 
nication. However, this balance should not be- 
come overbearing. Peer pressure alone will act 
as a motivator to get people working. 

The business world is in transition, and co- 
operative efforts are increasingly important. 
Therefore, participating in collective projects is 
advantageous. 

Experience has shown that frequently stu- 
dents learn better when they work in groups. 
Rewarding adult group performance is more 
valuable than rewarding individual perfor- 
mance. 

In what distance learning situation can collec- 
tive learning be most beneficial and why? 

Students. Whenever a group is formed, it 
will have group characteristics that depend on 
the individuals and the relationships among 
individuals. Instructional design must take into 
account the degree of homogeneity (match or 
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mismatch in talent, interest, level of effort, 
motivations, etc), bonding (strong friendships 
can foe formed and exploited), synergism, and 
the phenomenon of group d)mamics. 



"One must desi^ collective learning with the 
group size in mind. " 



Studies have shown that students prefer to 
learn in groups in many situations. There are, 
of course, exceptions, and any course of in- 
struction needs to allow for those preferences. 

The collective level of expertise in the 
group will determine the requirements for di- 
rect interaction by the instructor. In general, 
the lower the level of existing knowledge, the 
greater the need for instructor interaction. 

Teachers. Teachers may be threatened by 
the collective learning model because their 
"dominant role" may be diminished. New 
training will be required for the changing role 
of teachers. Perhaps a new concept of the 
teacher will be as a group manager or facilita- 
tor. 

Challenges. Currently, many avi> liable 
sources of information are not used. Perhaps 
the most significant example is the wealth of 
experience that senior citizens have. If dis- 
tance learning (in the collective learning mode) 
could tap into some of those sources, the re- 
wards would be tremendous. 

The distance learning environment needs 
to be carefully considered in collective learn- 
ing. However, many aspects will be nearly the 
s?me as in the traditional classroom. In some 
cases, the possible asynchronous interaction 
may be advantageous; that is, decisions or solu- 
tions would be corsidered more clearly before 
a reply is made. 

What are the preferred media for collective 
learning in distance learning? 

This group redefined the problem by noting 
that media are not the issue. If the appropriate 
collective learning tasks are identified ^.nd the 
appropriate strategy for a specific requirement 
is established, then any of the media can 



be adapted to the task. Hence, the group 
focused on appropriate tasks and situations 
for coUecttve learning. 

What are the reasons for using collective 
learning? Three valid reasons for using collec- 
tive learning follow: 

■ To work at the synthesis level of Bloom's 
taxonomy, converging to similar ideas, 

■ To work in a problem solving situation and 
reach a solution, and 

■ To encourage group interaction and coop- 
eration. 

In addition, the motivational aspects of 
group work may be sufficient justification for 
having collective learning experiences. Train- 
ing objectives determine whether or not collec- 
tive learning is a desirable strategy, with media 
selection following accordingly. 

Indeed, collective learning is probably not 
useful at the lower cognitive training levels (the 
introductory level, for example). For example, 
one would not use collective learning to teach 
someone a basic mechanical skill (how to 
change an XYZ brake), but collective learning 
can be used for training on how to fix brake 
systems in a general way. 

Trainers must be confident of the optimal 
instructional strategy. A professional training 
specialist from the discussion group said that 
he has seen three types of collective learning in 
practice: 1) a professor places a problem on 
the table and has the group solve it; 2) some- 
one does not want to work with the group, so 
everyone works on individual pieces and the 
group synthesizes results; and 3) a hybrid oc- 
curs and the individualiits work by themselves 
and others work as a team. Eventually, they fit 
the pieces together. The real point is not to 
make individualists outcasts but not permit 
them to hinder the learning process either. 



''Collective learning goals are clarification of 
concepts, problem solving, synthesis, evalua- 
tion, and affective domain (interpersonal 
skills)/' 
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Collective learning content is related to a 
goal, which is different from traditional dis- 
tance learning that looks for specific answers 
from individuals* Using teleconferencing, a 
class could work together. In this r^ard, a 
participant asked whether or not our distance 
learning conference could have been accom- 
plished by distance learning. Most group 
members felt that the initial face-to-face con- 
tacts were necessary as well as the opportunity 
to establish a network among distance learning 
advocates. However, they agreed that using 
two-way video could have worked for the small- 
group sessions. Even computer-based training 
could have been used, where a person is effec- 
tively talking to the terminal. 

If learning goals demand group dynamics, 
there is literature that points out how to in- 
clude the outsiders. The nominal group tech- 
nique allows for everyone to individually brain- 
storm a list and then pick one item from each 
person's list, going around as often as neces- 
sary and sharing the collective list. 

In miiltidisciplinary groups, one is chal- 
lenged to get disparate personalities and back- 
grounds together and to employ appropriate 
techniques for the remote learning systems 
that we are designing. In projects where indi- 
viduals do not know everything, they can rely 
on ot er people to fill in the gaps. However, if 
the only expert leaves, the group loses part of 
its collective power. 

One must avoid trying to apply collective 
learning to every situation. For example, in a 
math game, an individual might solve a prob- 
lem in 10 minutes, yet a group does it in 20 
minutes. However, in survival games, people 
are put in unpleasant situations and are tasked 
to compile a list of things one might need. In 
this case, individuals tend to be less effective 
than the group consensus. Sometimes an indi- 
vidual on a team will have a valid solution and 
may be talked out of it. Nevertheless, overall 
consensus may be better than one person's 
solution. Instructional designers must consider 
both short- and long-term outcomes. Perhaps 



wasting tin at the beginning, may bring better 
long-term results. 

If one is looking strictly for answers, then 
collective training might well be the wrong ap- 
proach. In fact, this collective training idea is 
contrary to the notion of individualized train- 
ing. Collective training might be more appro- 
priate for executives than for blue-collar work- 
ers because collective learning is quite applica- 
ble to upper management where people are 
trying to develop strategic, marketing, produc- 
tion, and financial plans. In the business world, 
collective learning night help a team function 
mere efficiently and more effectively. 

The application of distance learning tech- 
nologies does not excuse us from remembering 
what we already know. We still have to con- 
sider muhiple strategies, everything we already 
know, and not expect collective learning to be a 
panacea. There is a danger of forgetting what 
we know about the traditional classroom set- 
ting. The technology itself is seductive, and 
learning about it can be so absorbing that we 
forget our actual goals. 

A medium that would let the group draw 
on many resources to act as a group could be 
very valuable. Distance learning learners do 
not always have a library like traditional learn- 
ers have. A way to integrate resources such as 
bibliographies, dictionaries, etc., into the rest 
of the system could be very important. This is 
also a policy question, not a media problem. If 
not done properly, we will create the language 
labs of 30 years ago that were not used. While 
the requirements of learning should drive the 
strategy used, implementation of the strategy 
in a given medium must be done effectively. 
Further, the media must be both affordable 
and available. 

Most of the discussion addressed pushing 
the cognitive evaluation of issues rather than 
the affective domain, yet group learning tends 
to be more involved with the latter. It is im- 
portant to develop models for cognitive, physi- 
cal, and affective domains for particular subject 
areas. 
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Summary 

Collective learning is a valuable instructional strategy in the distance learning environment. 
Thia instructional strategy promotes teamwork, reduces the isolation common in distance learning, 
provides motivation, enhances pacing of the class, could reduce dropouts, and offers no difference 
between traditional and distance leamin^^ in task characteristics. The bonding that occurs in the 
interacting community is also important. Such an instructional strategy could also capitalize or the 
knowledge of the retired population. Distance learning facilitates capturing the collective (earning 
corporate knowledge of individuals, which otherwise would be lost. 

It is easier to define where collective learning should not be used than where it should be used. 
Some autonomous learners and anxious people shun collective l^^ming. However, it is a tool that 
can be used to soh^e problems that are bigger than a single individual's ability to soh^e them. 

Collective learning goals are clarLlcation of concepts, problem solving, synthesis, evaluation, 
and interpersonal skilk (the affective domain). This strategy is process oriented rather than 
answer oriented. 

The structure of collective learning depends on its objectives, the subject, and the participants 
and may determine the delivery method, synchronous versus asynchronous. 

In a collective learning environment, the instructor's authority is not diminished, just changed, 
becau&e the ijituation requires increased evaluative skills rather than presentation expertise. The 
instructor serves as a catalyst, for providing proper and timely feedback is critical. 

Some cautions concerning collective learning included the fact that some students work better 
computer-to-computer versus face-to-face. Also, the subject matter, the student, and the instructor 
are all dependent on each other. One concern noted was the possibility of collective learning's im- 
pairing individual learning skills. One participant remarked that the applicability and effectiveness 
of collective learning is dependent on the synchronous interactivity and objectives of the selected 
media. 

References: 

Moore, Michael G., Three Types of Interaction,* in Readmgs in PrincipUs of Distance Education 1, M. G. Moore and G. C Qark, Eds., 
100-1Q5 (1989). 
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Student Pertormance Evalttation 

by Norman D. Homer 

Background 

Determining whether or not a person has mastered a course or deciding if a person can be 
certified as qualified in the subject matter should be major distance leamirg issues. In traditional 
education/training situations, the instructor is usually in a position to direcUy assess students' abili- 
ties in real time. However, large classes and time pressures are forcing the use of less direct test- 
ing procedures. In distance learning, the situation is compounded because the capability for direct 
feedback may not exist. In many accounts about distance learning experiences, one hears about 
students* passing tests without actually understanding the content and about people who are frus- 
trated by learning the course material and failing the evaluation procedure. Distance learning pre- 
sents unique challenges to evaluating student performance; these diallenges do not exist in the 
traditional classroom situation. 



''Students have been certified from distance learning courses when, in fact, they hme not mas 
tered the material Students who have mastered the material have been frustrated by the as- 
sessment process. The problem is often the testing, not the instruction. " 



Assumptions 

Evaluation of student performance is a critical element in any distance learning system. In 
some cases, the evaluation system may exist only for self-assessment. However, the trend is for 
employers to require certification of employees* performance. 

A model for proper student performance evaluation in distance learning can and should be 
constructed, we are to certify performance, then a standard for performance evaluation must be 
established. om this standard, a model or models for evaluation in the distance learning setting 
must be developed. 

Constraction of Evaluation Systems 

Should some ^)ecific method or principle be embraced as being the best or most accurate for 
measuring student performance in the distance learning environment? To adequately answer this 
question, a number of factors need to be considered: 

■ types of tests, 

■ test content, 

■ administration, 

■ role of the instructor, and 
H interactions. 

Test types generally fall into two main classifications: textual 2nd performance. By textual, we 
mean print on paper and computer-presented questions and answers. Performance refers to sim- 
ulations, games, interviews (either d'irect or indirect), and interactive systems, such as holographic 
imaging interfaced to interactive devices (for example, the '^NASA glove*). The system used can 
have a profound effect on the type of evaluation possible. 

Th** actual test content is critical in the distance learning environment. Problems-such as 
misinterpretation because of the absence of direct intervention, lack of test validity because of cul- 
tural and social factors, and cognitive-level mismatch, especially at higher cognitive levels, where 
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assessment in a distant environment can be difficult-can render the evaluation process virtually 
meaningless. 

In distance learning assessment, administration can pose different problems from those expe- 
rienced in conventional classroom situations. Problems of dealing with cheating, distractions, tim- 
ing, and misinterpretations can be quite different from those normally encountered. 

The role of the Instructor in testing in the distance learning environment can be quite varied. 
The instructor may be directly involved in the testing, or he may have no role at all. The level of 
involvement depends partly on the nature of interactions in the testing environment, which can be 
quite different from those encountered in the classroom. Generally, interactions in distance 
learning must be anticipated in the course and in the testing. 

General Remarlcs on Scenarios 

Different scenarios were presented to each group to stimulate and encourage thinking in new 
areas. However, some of the scenarios might have been drawn too restrictively, and the discus- 
sions did not progress according to expectations because unique challenges were posed. As we en- 
ter new areas, we are reluctant to proceed aggressively and inevitably carry the baggage of our own 
experiences. To initiate new teaching methods in the distance learning environment, we must ha 
the courage to set aside some of our preconceived notions and not worry about deviating from 
some established systems. 



Scenarios and Results 

Scenario. Certify whether medical interns 
who have been taking a satellite course in re- 
mote areas of South America can properly per- 
form an appendectomy. 

Results. This scenario certainly entails one 
of the most adverse testing conditions. The 
difficulty of assessing fine motor skills required 
for surgery is compounded by the requirement 
of near perfect performance. 

Only under extreme circumstances and 
with no other alternatives would the group be 
able to accept certification of the intern in a 
distance learning environment in the near fu- 
ture because of the life-threatening nature of 
the situation. 



7 would not like a doctor certified by a cor- 
respondence course operating on me. If this 
were a hair dresser or even a diamond cutter, 
we could certify. But not a surgeon!" 



The participants concluded that remote 
learning techniques are not suitable for some 
types of skill assessment and that account- 
ability and risk levels were significant factors in 
establishing the suitability of distant evaluation. 
The higher the level of risk, the less likely we 



are to rely on distance learning to certify a per- 
son without actually performing the operation. 

Certainly distance learning and testing can 
be used to certify some medical skills. The 
group noted that knowledge concerning various 
surgical procedures could be tested by showing 
video images and querying verbally about what 
the correct procedute would be. This method 
could be used to expose interns to situations 
not generally encountered. However, the 
group was reluctant to propose a method to as- 
sess actual surgical procedures. Furthermore, 
participants agreed that accountability was a 
significant factor in establishing the suitability 
of distant evaluation. 

Scenario. The U.S. Army Command and 
General Staff College has decided to admin- 
ister the course of instruction developed by the 
Combined Arms Staff Services School (CAS^) 
through distance learning. The course will be 
administered by the College's School for Cor- 
responding Studies to both Active and Reserve 
units. Distance learning is the chosen method 
of presentation because Reservists cannot take 
a 13-week resident course. For others, dis- 
tance learning would be just an alternative. All 
instructional materials have been developed, 
but a method for certification of student skills 
must be developed. Evaluation will be 
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conducted on levels up to synthesis and analy- 
sis. 

Graduates of the CAS^ course are expected 
to perform at a minimum standard of excel- 
lence when assigned to division staffs in the ar- 
eas of personnel and administration; intelli- 
gence; operations, plans, and training; and lo- 
gistics and maintenance. When assigned to a 
division staff position, the officer must work in- 
teractively with other staff officers to produce 
coordinated plans and orders as well as to ap- 
ply and develop heuristic strategies for decision 
making. 

Results. The CAS^ scenario group felt that 
it was important to determine how the training 
was to be done before the evaluation scheme 
was determined. Three possible organizational 
setups were proposed. 

Case 1 entails an active-duty leader pre- 
senting instruction in a traditional classroom. 



Case 2 assumes that the leader is not present 
and that the Reserve Components are receiv- 
mg mrJividua! instruction at home. Lastly, 
Case 3 supposes that the leader/instructor is 
not present but is responsible for two groups 
and that the Reserve Components are re- 
ceiving instruction in an armory. 

For these learning environments, delayed 
feedback and evaluation are reasonable, partic- 
ularly in situations where Reserve units have to 
participate in a part-time capacity. For the 
remote instruction situations, synchronous con- 
ferencing in a variety of media could be used to 
observe or record the student interaction pro- 
cess. 

The group decided that the evaluation pro- 
cess could be divided into three areas: writing 
skills, orals skills, and interactivity. The rec- 
ommended iypes of evaluation for the various 
cases are presented in the following figure. 




While the methods of recording perform- 
ance are plausible with existing technology, the 
evaluation of such results is always very time 
consuming and subjective in nature. 

Scenario. Test whether dealer mechanics 
throughout the U.S. know how to repair a new, 
sophisticated carburetor. 



Results. Early in the discussion of this sce- 
nario, a participant pointed out that a training 
and evaluation system for mechanics had been 
developed recently for Nissan. Someone ques- 
tioned why mechanics needed distance learn- 
ing. Why not have all mechanics checked out 
personally by the head mechanic? However, 
the group considered that option impractical 
because of the increasing complexity of cars 
and because of the large number of mechanics 
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who must be qualified at a dealership. The 
standard method of updating mechanics will 
require some travel to group classes as well as 
more implementation of distance learning 
training. 

"Testing must be consistent with the training 
metl'ocL" 



The use of computers for training of me- 
chanics seems extremely sensible as dealer- 
ships will already possess computer systems for 
inventories and accounting. Many dealerships 
are or will be on networks that could distribute 
courseware and conduct the student evalua- 
tion. 

The group agreed that in certain area 
more and more certification will be required by 
local and federal agencies because of envi- 
ronmental and safety issues. 

In the actual evaluation, the group assumed 
that mechanics would not be tested in physical 
manipulation skills. It would be assumed that 
physical dexterity would already have been de- 
veloped through other training. With these as- 
sumptions, the group determined that a touch- 
screen graphics system could interrogate a 
trainee concerning the order of parts for disas- 
sembly and reassembly. It could also show ex- 
amples of the condition of parts and ask if re- 
placement should be considered necessary. 

Although the group found its scenario to be 
too constricting, it did reach the following gen- 
eral conclusions: 

■ The computer can be used to teach and 
evaluate. 

■ We have unlimited human resources. 

• A large number of people could benefit 
from this type of training within the deal- 
ership. 

■ The number of trainees and their dis- 
tribution determines the appropriate 
training method. 



■ For the future, evaluation and certification 
will become crucial issues in any training 
program. 

Scenario. Test w>- -ther 1,500 second-year 
university students fi hroughout the U.S. 
know French well eno ^. tO attend university 
classes in Paris next year. 

Rt^c \ At the beginning of this session, 
group me*nbers objected to the presenter's as- 
sertion that little literature is available on eval- 
uation. They pointed out that Canada, Aus- 
tralia, and Europe have quite a bit of literature 
on evaluation. 

The U.S. tends to be too introspective, and 
we should research what has already been ac- 
complished elsewhere in the world. It is d'fli- 
cult to study evaluation in the U.S. because lit- 
tle attention has been paid to the certification 
issue in distance learning. In addition, it is dif- 
ficult to ascertain what the rest of the world is 
doing as few libraries carry many of the non- 
U.S. journals. In the distance learning arena, in 
particular, we should make an effort to over- 
come these barriers to our own learning. 

This scenai:.^ generated some problems 
that were not present in the other scenarios. 
First, writing and reading French could be 
handled with standard evaluation techniques 
appropriate for any distance learning course, 
but in this scenario the problem was to assess 
the students' ability to understand and speak 
French, iu addition, is it necessary to require 
different levels of proficiency between read/ 
write and speak/understand abilities? 

The group decided that in the speak/ 
understand assessments, the first aspect to con- 
sider was understanding. To handle this as- 
sessment, the students could listen to tape cas- 
settes of a Sorbonne-levei lecture, for example, 
and then write a summary of what they heard. 
Tills method would require that the students be 
placed under classroom-like test conditions. 
(In u distance learning situation, this arrange- 
ment provides opportunities to cheat. Who 
knows and can verify the identity of the stu- 
dents?) Higher cognitive levels could be tested 
by having the students analyze and evaluate in 
French what they had heard on the tapes. 
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Although tape exchange was considered to 
be a reasonable evaluation method, many 
unanswered questions remained. Is there 
enough time for feedback to be useful? Will 
there be some scheme for retesting? Shouldn't 
a pilot test be conducted ahead of time? 



yir^ quality design for e.^aluation should 
have a lot of room for self-assessment. " 



Grading large quantities of test responses 
will be difficult. For this scenario, the group 



decided that the test could be used for the stu- 
dents to do self*screening, that is, to let them 
check their own answers so that they can de- 
termine the level they have attained. They 
could then determine for themselves if they 
could study comfortably in France. The group 
also considered that such an assessment should 
not be handled by distance learning techniques. 

The traditional evaluation techniques may 
still be the most appropriate methods to handle 
this type of problem. 



Summary 

In handling the difficulties presented in the scenarios above, we should not ignore the benefits 
and challenges of evaluation that exist in a distance learning environment, but not in a traditional 
learning situation. 

In distance learning, we have the opportunity to better control feedback on students' perfor- 
mance. Testing can be accomplished so that students can learn from their mistakes as well as as- 
sess ihe need for further training. Evaluation systems can be self-pacing, flexible, patient, and 
reusable. 

All of the participants were concerned that the peop e conducting and demanding certification 
may have little involvement with the establishment of the educational objectives of distance learn- 
ing courses. Certification requirements will probably filter down from above to the course design- 
ers and instructors who will have to incorporate them without destroying good educational prac- 
tices. Ideally, certification will not become the tail that wags the dog. 

We must also be careful not to transfer traditional models into the newer media of distance 
learning without attempting to devise new approaches. We are in the enthusiastic, fledgling state 
and should experiment, but we also need to consider how distance learning can become a strong, 
mature field in its own right. 
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ImplementaHon 

Background ^ , , , 

Consensus indicates that distance learning will play a greater role in future education, whue 
the traditional classroom/schoolhouse approach declines in popularity. Despite this uituitively 
obvious conclusion, institutions are amazingly resistant to change and normally do so only when 
pressured overwhehning external forces. However, on rare occasions, luminaries emerge who 
have both the foresi^t and the organizational ability to cause and direct dramatic change before 
the organization experiences the woes inflicted those external forces. Ideally, this group can 
serve as the strategic planners to steer distance learning into mainstream organizations of the fu- 
ture. 

We resist change for many reasons: 
■ financial cost, 



■ lack of technology, 

• lack of skills (delivery/student/instructor), 

■ lack of understanding of a new approach, and 

■ vested interest in the current approach (comfort zone/inertia). 

What is needed is a plan that not only overcomes these obstacles but is also so attractive to po- 
tential educators and their administrative decision makers that they will accept the concepts. 

With finesse, this acceptance will be accomplished so that it convinces the educators that they 
originated the ideas. The challenge is to gain acceptance of distance learning and acknowledgment 
of tht major contribution it can make to society. 

Organizational change requires three entities: an identifiable product to which people can re- 
late, proof of accomplishment, and, finally, organizational executive support. 

Because we know where we are at this point, we must create the desired objective state and 
then design a plan to that state from the present. This plan should include the following: 

m Strategies to gain acceptance, 

■ demonstrations of significant advantages, 

■ technology requirements, 

■ methodologies to educate users (educators and students), 
« instructional techniques, 

« cun xulum development techniques/requirements, 

■ evaluation methodologies, 

• determination of decision makers to be influenced, 
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• identification of resources required (people, funding, knowledge, things, time), and 

• identification of the responsible action agency. 

Implementation questions to be answered by the conferees included the following: 
= How should distance learning be implemented in future exlucational/organization settings? 

• What do we as a nation need to do to exploit distance learning capabilities? 

To prevent this task from becoming overwhelming in the tim<i allotted, we divided the effort 
among four groups. We asked each group to produce at least an outline that would provide the 
guidelines for addressing the problem statement. The goal was to develop a generic strategy that, 
with appropriate modification, could be tailored to successfully cause the smooth introduction and 
acceptance of distance learning. In addition, a fifth group, representing a cross section of distance 
learning advocates, was created to discuss immediate implementation. 



What methodologies should be used to in- 
form/eduaite those involved in distance 
learning, including students, educators, ad- 
ministrators, and technicians? 

Results 

• DeHne administrators as implementors and 
technicians as product /delivery support. 

• Use distance learning techniques to in- 
form/educate. 

• Target information to the audience, 

9 Point out beneHts from implementation, 

■ Point out consequences if not imple- 
mented. 

m Emphasize short-term advantages, 

■ Emphasize the opportunity to employ high 
technology^ a useful tactic at the policy 
maker/administrator/educator level, 

• Add executive/policy maker as fifth cate- 
gory to the list of people requiring informa- 
tion or education, 

■ Emphasize specific problemf s). 

• Design a generic distance learning strategy. 



In addition to the major points, the follow- 
ing commentary was made about the question 
provided. The group decided to provide defini- 
tions for the terms administrator, manager, and 
technician. An administrator was seen as one 
who implements policy provided by an external 
group. For example, local schools follow state 
guidelines. Managers function much like ad- 
ministrators but have resources to allocate. 
Technicians deliver support functions, such as 
camera operators. 

Technicians are important as they advise 
on the level of technological support available. 
On the other hand, because of the general lack 
of creativity, we have "talking heads" on video 
screens. 

Cost must be refined when talking to policy 
makers. A person must be able to address all 
kinds of cx}sts involved-direct costs, sunk costs, 
direct savings, indirect savings, and cost avoid- 
ance. Cost is not only measured in dollars but 
also in time, equipment, and other assets. 

To influence each category, we must be 
able to answer the question: What is in this for 
me (the person in that position), or what is the 
drawback of not doing it (distance learning)? 
To answer these questions, the following chart 
was generated. 
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Implementation Rewards/Nonimplementation Drawbacks 


Tarpct Audience 
Exeaitives/Policy Makers 


jfTnpl^mentatlon Rewards 
Increased productivity 
Increased cusiomcr satisfiicaon 
Hi^cr proHt margins 

R^ff«r )v«ini*H M«r\vt^*#>c 
OCUCl imnCU WUlKCla 

Lower turnover 


Kotenttai Risks 
of Nonlmolementation 
Falling behind competitors 
Loss of money/capability 


Administrators/ 
Implerocntors 


Fewer resources required or more 
accomplished with existing re- 
sourccf 

Promotions by high-visibility project 
Added flexibility 


Failure to meet stated objective 
Administrative consolidation 


Te«chcrs/Pres« n (crs 


Recognition, credibility, and visibility 
Increased expectancy level 
Shift onus of learning to student 
Solution for discipline problems 
Team teaching 
\jtc oi cofiieni 

Global access to other teachers 
Improved teacher/student interactions 
Improved resource selection/integration 
Better selection and integration of materials 

and teaching resources 
Better teacher/student interaction 
Experts available via satellite 


Increased work load 
Loss of certification 


Students 


Increased teaming opportunities/. 

CUilVvilICiKX* • > Wlicil, "iitiw, aiiu 

how to learn subject matter 
Access to otherwise unavailable 

courseware 
Availability of more studcnt*stude nt 

interactions 
New, vibrant presentations 
Increased subject rratter depth available 


Subjects unavailable 
Limited depth of subject matter 
Unmet graduation requiremenu 
More time in classroom required 
Inability to *go to* college 
Lack of job opportunities 
Lack of opportunity to excel, 
especially in the military 


Community 


Enhanced self-image r-d ouUide image 

of community 
Better training of community service 

nrovkiers ^Dolice fire, etc ^ 
Labor force retraining capability 
Better informed citizenry 
Improved ability to attract industry 
Ability to maintain cultural tics 
Support for civic clubs, churches, etc. 
Greatly enhanced adult education 

opportunities 


Loss of autonomy 
School consolidation 
Decreased tax base 


Technicians (Prodiidion/ 
Delivery Support) 


Incorporation into creative process 
Potential for skill enhancement 
Creativity outlet 

Barriers broken down with educators 
Increased job status/salaries 
Enhanced status 
Increased/improved hardware 


Lack of work 
Limitations of constant/ 
decreasing budget situation 

Source: Small Discussion Group A 
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The group noted that q>ecific objectives 
must be defined and that the proposal must 
show concrete problem sohong. General com- 
ments aboui benefits will not be sufficient to 
gain a favorable decision that requires resource 
allocation. 

Example of applications in which effective 
use has achieved positive results were sug- 
gested. Examples include higher sales and 
profits, competitive advantages, better trained 
workers, lower turnover, or improved safety 
records. Public schools are very sensitive to 
the quality of their product. Small school dis- 
tricts generally cannot compete for top teach- 
ers. Distance learning may provide the only vi- 
able option for them to have high-level instruc- 
tion in technical areas. 

Administrators. They should implement 
and manage distance learning They may 
demonstrate that they can perform their job 
responsibilities more effectively for the same 
funding cunently available. This approach 
provides an additional dimension in flexibility. 

They can be ittracted to personal recogni- 
tion for having cone a good job and for keep- 
ing abreast with advances in their field. Some 
administrators want hands-on products they 
can try out, which should be done in such a way 
that minimizes the risk of embarrassing them. 
Make it fun. 

Schools generally try to avoid consolida- 
tion. Distance learning provides an opportu- 
nity to share resources and remain autono- 
nious. Furthermore, satellite links are rela- 
tively inexpensive. 

Educators. They may be influenced by 
recognition, visibility, and credibility in their 
field by collaborating with broadcasts. This ap- 
proach provides a better selection of course 
material and expert resources to draw on and 
allows the teachers to Integrate the distance 
learning lessons into their own courses. 

Teachers must be trained in distance learn- 
ing techniques so that they understand the ca- 
pabilities of the system, and teachers should be 
involved in the management of the program 
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Distance learning could be linked to merit 
pay. Some feel that acceptance will come only 
if associated with pay. 

Students. Distance learning meets the 
time requirements of adult students and may 
be more convenient in method of delivery. 
They will be able to see top-quality delivery 
and esqplore topics at the desired depth. Dis- 
tance learning provides for a potential^ higher 
degree of student control regarding pace, 
choice of materials, order, and access to help. 

Distance learning provides for interactivity 
among students. The business world likes net- 
working concepts and has benefited by allowing 
and encouraging the exchange of ideas through 
interactivity. Distance learning also provides a 
multimedia curriculum, which could meet stu- 
dents' varying learning styles and could reduce 
the actual delivery time, allowing flexibility and 
maximum use of learning time. 

Technicians. They should be renamed as 
operational support and not be teachers, but 
they may be highly educated individuals who 
are required to keep up with the state-of-the- 
art in technology. The whole system will fail 
without them. 

In the military, there is a significant chal- 
lenge to get educators and technicians to work 
together; using technicians to help implement 
distance leaming would remove the perceived 
low social status of being a technician. 

General Issues 

Community support is necessary because it 
frequently provides the needed physical facili- 
ties. Distance leaming can be used to support 
civic organizations and more traditional educa- 
tion institutions. Public television provides an 
opportunity to offer distance learning courses. 

The public image of a community is impor- 
tant, and having better-educated people will at- 
tract industry. More employment in higher 
paying jobs will raise the tax base of that com- 
munity. 

In addition, muhicuhural communities can 
maintain ethnic ties. 
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SignUIcance 

e Wc recognized that if one wants to sell dis- 
tance learning, a person should use the 
same tools used to sell anything else. 

• We can use distance learning to sell dis- 
tance learning and products, such as a par- 
ticular educational television channel. 

■ We must target presentations to the audi- 
ence. 

What do decision makers need to be positively 
influenced, and how should such an action be 
accomplished? 

Results 

■ Decision makers are di.spersed (military, 
public education, business). 

■ Distance learning needs top-level (CEO) 
support but also needs concurrence from 
many sources. 

■ We need a strategy to influence top-level 
executives. 

• Other users (Who has done it before?) 

- Low down-side risk (off the shelf and 
field proven) 

- Bottom line (cost-effective financial 
climate) 

• Use heavy lobbying effort for political 
appointees and tie their names to posi- 
tive results. 

In large organizations, such as the military, 
public education, or big business, decision 
making is far more diffuse than generally real- 
ized. Even though an organization has a com- 
mander or CEO, it rarely makes decisions 
without the support, advice, or consent of many 
others. 



. . a rush to be second." 



Those who provide input are not homoge- 
neous bodies and frequently have agendas and 
interests that vary greatly from those of the top 
decision maker. To influence these people, 
one must know and understand the differing 
viewpoints of each group and be able to tailor, 



in a consistent fashion, arguments that will gain 
their support. 

With many CEOs, there is a "rush to be 
second,** which implies that th^ wish to be 
seen as forward thinking and that they ac- 
complish business by quickly adopting new, in- 
novative ideas. This approach is a risk reduc- 
tion technique, which if well executed, allows 
large organizations to appear to be leaders. To 
influence this group, one must be able to tell 
them who has successfully employed the tech- 
nique or program being advocated. 

Low down-side risk means that managers 
like programs that provide only small losses in 
the event of failure. Such low down-side risk is 
managed by using only existing technology, 
which can be bought "off the shelf without re- 
search and development. Furthermore, they 
prefer field-tested and proven approaches. 

With the military, and some companies, a 
leadership turnover problem exists. F *.ople do 
not remain in place long enough to formulate 
and implement programs. 



"My main problem is mean time between 
mind changes. "... Col. Lunsford, U.S. Army 
Project Manager, Training Devices 

Influencing groups who experience high 
turnover rates to use distance learning means 
continuous updating and backtracking. One 
must follow the changes in organizations and 
be prepared to meet with and convince new 
key players, which can be difficult if the per- 
sonnel action was designed to generate a ^ 
change in direction, such as with a new political 
party coming into office. 

Agreement going up the chain of command 
is important for program initiation. Once es- 
tablished, agreement coming down is important 
for successful implementation of the program. 

We need tc have a champion who will 
**carry the ball** and see that actions are exe- 
cuted. This person may, at times, have to 
subordinate his/her wishes and give credit to a 
more senior official who desires to be per- 
ceived as the concept leader. Frequently, both 
positions will be required to reach the goal. 
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For projects requiring political support, we 
must allow politicians to be identified as the 
proponents of successful projects. Intense lob- 
bying is someiimes required to gain their sup* 
port. 

User support is important and includes 
both students and parents in the schools. In 
industry, it includes workers and supervisors. 

Industry will respond to cost savings. 
Demonstration projects are a good and safe 
way to obtain further support. Training as pro- 
tection for investment also makes a strong 
case. Training budgets are tied to production 
priorities, and high-priority projects that di- 
rectly impact production are more likely to be 
funded than maintenance functions. 

An approach that would join industry and 
local schools would be to have consortia adopt 
groups of schools in support of distance learn- 
ing. Having consortia involvement can prevent 
turf battles that emerge if single companies es- 
tablish relationships with specific schools. In 
addition, people are concerned that telecom- 
munications companies may exploit the field 
for future profit. 



Issue: 

Do we need a national strategy? YES! 



Caution: Some feel this idea "flies in the 
face" of 200 years of tradition of independence 
of local school systems. 

However, issues, such as interstate 
certification of instructors and instruction, 
would be handled more easily with a national 
approach. We must establish standards at the 
national level. 

Technology now permits far greater distri- 
bution of training than has been possible pre- 
viously. We must capitalize on the advantages 
provided by this opportunity. A group member 
suggested that the policy and funding should 
come from the federal level, but the execution 
and administration of the programs should be 
conducted at the state level. However, such an 
approach would require a great deal of atten- 
tion to details. 
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At present, not a single organization sup- 
ports distance learning and can act as a lobby- 
ing force at the national level. Nevertheless, 
momentum exists at the national level and is 
evidenced by the Office of Technology Assess- 
ment's (OTA) study on distance learning re- 
quest'xl by four senior senators. Additionally, 
President Bush has acknowledged distance 
learning publicly on several occasions. 

Two organizational approaches were sug- 
gested. There was general, but not total, 
agreement that a national distance learning ini- 
tiative should be conducted from within the 
government. The second approach suggested a 
nongovernmental body with close ties to the 
government. 

In the governmental approach, the Depart- 
ment of Education would establish a deputy di- 
rector position for distance learning. 

Recommendations 

« Apply both top-down and bottom-up initia- 
tives. Neither will succeed alone. 

a Get distance learning on the agenda for the 
next National Association of Governors 
meeting. 

« Call your governors and get them inter- 
ested in distance learning. 

« Establish a coordinated lobbying effort. 

• Promote business consortia in support of 
groups of schools. 

Significance 

■ Decision makers want 

- consensus, 

- the bottom line, and 

- risk management. 

« A national strategy is necessary for growth. 

« We need to work from the top down (lobby 
Congress, Department of Education, and 
governors;. 

■ We also need to work from the bottom up 
(inform school boards and administrators 
and substantiate with demonstrations). 
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What resources are required to implement a 
nailoiiil ulsuiiic^ learning strategy? 

Results 

The group suggested the following ideas: 

1. Increase the price of gasoline. WciMnpay 
for distance learning if we want it! 

2. Remove institutional barriers (for example, 
••ownership"). 

3. Allow alternate career paths (credit for 
course development and teaching as well as for 
research). 

4. Help top people become comfortable with 
computers. 

5 Work on para-educational systems. 

6. Work with high-status groups. 

7. Encourage cooperation, collaboration, and 
competition. 

8. Cultivate champions (friends in high 
places). 

9. Be certain that research has demonstrable 
results (rigorously provable). 

Comments on Policies 

m They may be established by industry's need 
for distance learning before educators or 
government does anything. (Will industry 
cause/generate a national policy?) 

m Employers may pressure universities into 
giving distance learning courses. 

m State and local authorities may have a sig- 
nificant effect on what is allowed to "flow 
in.* 

m They may develop from the ground up 
(showing worth of smaller projects that are 
linked into larger projects), which may be 
more effective in introducing distance 
learning than the top-down approach. 

Resources 

Instructional materials already exist in 
number of areas. A group member said that 



the University of the World was cited as an ex- 
curring. 

As far as equipment and facilities are con- 
cerned, TVs, computers, and telephone lines 
are in place in today's schools. 

Policy as a Resource 

Policy ^n be a resource because it is some- 
thing that must be created and developed. One 
must realize that any national policy (^n be a 
double-edged sword, as one may not like the 
policy or rigidity imposed on the system. To 
have a policy, goals need to be quantified. In 
developing goals and policy, it should be un- 
derstood that in the history of the U.S., edu- 
cation policies have been made at the local 
level. Educational administrators will be re- 
luctant to change the basic system they have in 
place. 

It may be best if national policy stays away 
from planning course content and detailed 
teaching methods. National policy should be 
directed more toward the base construction, 
such as getting funding for equipment and 
making money available for the training of the 
people who are to develop the distance learn- 
ing courses. National policy should also be di- 
rected to developing a center for storing, dis- 
seminating, and coordinating information 
dealing with distance learning. 

If a distance learning system is to be devel- 
oped nationwide, the question is how, when, 
and where to install it. Possible locations to 
consider are homes or schools. National Guard 
armories, and local libraries. However, this 
solution would be detrimental to those already 
disadvantaged by the technological revolution. 
A large number of microcomputers are already 
in place in the public school ^stem. Although 
these microcomputers are not state-of-the-art, 
to start a national system would be reasonably 
straightforward at this lower technology level. 
It would also provkJot equality of opportunity. 

From where will the leadership for imple- 
menting this resource come? If economics 
drives it, then the corporate bodies may be the 
initiators of distance learning policy, as they al- 
ready have a great commitment in this area. 
On the other hand, school administrators, as 
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we have already mentioned, will probably resist 
changes in policy that upset the status quo. In 
addition, at one university, departments were 
discouraged from producing courseware be- 
cause of disputes over ownership and over the 
dilemma of who would reap the rewards from 
the creation of the course. For these reasons 
alone, it is veiy likely that real distance learn- 
ing advancements will come from outside es- 
tablished school and university systems. How- 
ever, the effects outside of schools and the 
community, in general, will probably impact 
our entire society. 

Actually, general distance learning systems 
are already in place in many foreign countries. 
Maybe the U.S. should ascertain what can be 
learneJ from experiences in those countries. 

Significance 

No matter how quickly we develop policy, 
generate funding, or produce the hardware, 
finding people capable of developing effective 
distance learning will be the main problem for 
the near future. Why are the universities not 
gearing up to produce the people that are 
needed? 



. . no point in trying a rational approach to 
prove the value of distance learning over tra- 
ditional methods-OS no one has been able to 
prove rationally the value of traditional 
methods, and they have survived " 



What needs to be done to insure that the tech- 
nologies required to implement distance 
learning will be available when needed? 

Results 

The group identified the following needs: 

■ Learning must be taken out of the schools 
and made into a community issue for ev- 
erybody. Kindergarten through 12th grade 
is not enough. We must redefine the role 
of the school as the center of community 
learning. 

■ Perceptions of the distance learning gradu- 
ates must change. 

• Acceptance 

• Credibility 
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■ We n*^'*^ be^t***" naraHiamc r»n tUt* tmi-io/** /%f 

human replacement. 

The group proposed the following solu- 
tions: 

1. Change the national paradigm: 
educntion = lifelong community learning 

2. Use instructional technology + theory to 
support distance learning. 

3. Create the pull on technology with items # 1 
and #2 above. 

4. Identify the risks to society for not making 
changes indicated above in items #1 and #2. 

5. Work from the top down and the bottom up. 

6. Build an outstanding technology-based cur- 
riculum and make it available to everyone. 



"However, how does one sustain the push?" 



Although the group was asked to address 
the question of how to make the appropriate 
technology available when needed, it actually 
discussed the ways to implement distance 
learning as a whole. It would be to our ad- 
vantage if we knew what is inhibiting the im- 
plementation of distance learning today. Per- 
haps it is not technology that is holding us 
back. In addition, what are the research and 
development needs-both strategic and tactical? 

One problem is the perception that dis- 
tance learners are not as well educated as 
traditional students. The real point should be 
what you can do, mA what school you attended. 
The true issue here k one of differing stan- 
dards. If the educational system had a national 
standard, then there woc]d be no question of 
credibility. 



If an outside force had imposed our 
present educational system upon us, we 
would go to wan'' 



We do have significant problems with our 
educational system, and we need new educa- 
tional paradigms where technology is used to 
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enhance rather than replace human perfor- 
mance. This strategy should not overhaul the 
present educational system; instead, it will be 
an educational revolution. This type of change 
will have to be based on policy and the society. 
We need to take education out of the schools 
and into the community. Quality education 
needs to be available for all ages and locations, 
like health care is today. The new paradigm 
would require education to become lifelong 
learning, based in the community. Ultimately, 
it should be embarrassing to admit that one is 
not invoh^ed in education. 

First, we must convince the public that a 
problem exists. It is difficult to detect the 
consequences of poor education. To identify 
the risks, we have to establish the conse- 
quences of NOT making these types of 
changes. 

This strategy needs to be implemented by a 
tactical plan. Included in such a plan would be 
a huge public relations effort on the scale of 
the present media war on drugs. A 
Capraesque movie showing a future without 
these changes, along the calibre of "Dead 
Poet's Society" or with the type of message 
found in "Bright Lights, Big City," could be part 
of that effort. 

Technology will not be the thrust behind 
the changes. With better instructional technol- 
ogy and theory for distance learning along with 
this educational revolution, technology will be 
pulled along. The group agreed that having the 
needed technology at the appropriate time will 
not be a concern. 

What must we avoid if we want to see distance 
learning "take ofT?" 

M^or Points 

• We need a Strategic Education Initia- 
tive-not an emergency, but a crisis. 

• The leadership should be assumed by a na- 
tional lab-type organization. 

• We already have the resources, but they 
need to be organized properly, which does 
not require that much money. We need 
efficiency in funding research. 



• We do not need a center OF excellence, 
but a center FOR exceUence that combines 
the work of all the fine people in this field. 

• We need some type of infrastructure first, 
technology second (thai will draw the tech- 
nology into society). 

Commentaiy 

The group felt strongly that we need a 
calling: a'^senseofgoingto themoon." This 
feeling could capture the imagination of the 
American public and focus appropriate re- 
sources. In that respectf Michael Moore of 
Pennsylvania State University suggested that 
we need a Strategic Education Initiative (SEl). 

The SEI concept was very favorably re- 
ceived. However, consensus was not reached 
on how to implement such a scheme. Debate 
ensued about whether the initiative should be a 
government program versus one organized by 
the private sector. Arguments in favor of the 
private approach implied a lack of confidence 
in the capability or willingness of the federal 
government to organize and conduct such an 
innovative project. 

Participants noted that NASA and SDI 
have been successfully launched within the 
governmental structure and against stiff op- 
position. There was consensus that successful 
implementation of an SEI would require both a 
top-down and a bottom-up approach, and no 
single organization could accomplish the task 
alone. They mand red a united effort. 



"Distance learning is part of the solution to 
the education crisis, but it is not the whole so- 
lution. We are part of that solution. " 



Lifelong learning is everybody's business. 
We must develop new communities of scholars. 
Currently, education is drifting away from be- 
ing everyone's business to being concentrated 
in the schools-letting everyone "off the hook," 
which is unacceptable. Nevertheless, we persist 
in perceiving education in terms of the tradi- 
tional schoolhouse. Perhaps there is another 
viewpoint. Perhaps another perspective is the 
solution-more than just the schools. 
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Trying to put distance learning in the for- 
fiiat of costing institutions^ indeed^ is probabiy 
flawed. The natural tendency is to erect bar- 
riers because the instructor is threatened or 
because the institution is threatened. If dis- 
tance learning is properly presented, both 
could benefit. 

Furthermore, a national distance learning 
concept may also be flawed because of having 
to respect states' rights and other territorial 
boundaries. Trying to put distance learning 
into existing institutions using traditional for- 
mats is also probably flawed. To sell the con- 
cept of distance learning, we must sell the idea 
of re*conceptualizing our educational institu- 
t;ons-the schoolhouse and the traditional 
classroom. How we think of learning institu- 
tions must change, which will not be easy be- 
cause most people have grown up thinking of 
schools in a specific way. Underlying the dis- 
cussion was the tenet that we do not want to 
repeat mistakes that have already been made 
in the field of education. 



"Distance learning can improve the quality of 
education as well as provide an opportunity 
for expansion. " 



Using the open university concept, as op- 
posed to traditional methods, has reaped good 
results. We could sell distance learning using 
distance leaning. However, care must be 
taken to accc nmodate the cognitive level to 
the audience. 

The National Technology University is a 
direct result of industry's meeting a need. 
Each institute maintains its own courses but 
works toward a common goal because several 
industries financed it. If we could develop the 
trunk line that would facilitate better data 
communication, we would be in a more fa- 
vorable position. Perhaps when the cost of ed- 
V ion becomes excessive or the quality of ed- 
ucation becomes too inferior, parents may re- 
gard distance learning as a solution to the 
dilemma. 

Distance learning can improve the quality 
of education as well as provide an opportunity 
for expansion, yet institutions do not want to 
die. Can we risk stating that distance learning 
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prevents the demise of an uistitution? ''How 
turn of the century?" 



many blacksmitfts opened gas stations 
at the turn of the century?'' 



Distance learning is part of the solution to 
the education crisis, but it is not the whole so- 
lution. We are part of that solution. 

Strategic Education Initiative (SEI) 

We need an SEI. We are not in an emer- 
gency, but a crisis. The situation could be im- 
proved. Many positive projects are presently 
underway. Currently, distance learning propo- 
nents are decentralized and diffused. We do 
not need a center OF excellence (to exhibit it), 
but an SEI, a center FOR excellence (to pro- 
mote it) that incorporates existing organiza- 
tions/agencies and integrates, coordinates, and 
focuses the work of all the fine people in this 
field as well as disseminates information and 
projects an image. We need some type of in- 
frastructure first and technology second, 
meaning a way of integrating the technology 
into society. We should not exclude the exist- 
ing schools nor invent a totally new institution, 
but we should use the potential of distance 
learning as a parallel support opportunity. 



We need a Strategic Education 
Initiative. . . not an emergency, but a 
crisis. " 



With a national effort, we could achieve a 
national telecommunications-based system in 
5 years instead of in 25 yea. People tasked 
with the job of restructuring education with dis- 
tance learning could do so with strong national 
political support and the promise of financial 
assistance. Actually, we do not need more 
money devoted to solving the education crisis. 
However, we do need a reapportionment of 
existing funding to capitalize on solutions with 
greater potential. 

In fact, we can probably save money. Even 
if SEI were funded at $10M a year, that 
amount would merely be a drop in the bucket. 
However, if we has to **pend significant time 
justifying such amoums, we would not progress. 
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We need more efficietK^ in funding research. 
Ten roiuiori dollars would not uisny peo* 
pie, but it could fmance an outstanding center 
for excellence. 

Not reaching 9,000,000 kids is a national 
emergency. We lose half of all kindergarten 
through 12th grade students by their dropping 
out. Packi*3g these students' brains with infor- 
mation should not be the goal of learning at 
this level, but we should strive to teach them 
how to learn. We need to look b^ond tech- 
nology and redesign the role of the teacher. 
We can restructure the role of the teacher by 
changing the curriculum of teacher training. 
We need to re-examine our expectations of the 
education system. 

We also need to re-conceptualize what edu- 
cation is. Our expectation of education has to 
change. If people (including the teacher) can 
discover things mutually, the learning environ- 
ment may change. Learning will become ex- 
citing! 

Leadership 

Distance learning needs a high-level cham- 
pion. We need a national leader who will pro- 
pose that we need such an SET effort. This 
leadei should be supported by grassroots ef- 
forts across the country. We have to handle 
the situation differently to capture the atten- 
tion of a politician. We must contact state sen- 
ators and representatives and offer these par- 
ticular suggestions. We need to write letters to 
motivate them to become involved as distance 
learning advocates. Such a distance learning 
initiative can certainly be appropriate in the 
changing perspective and image of the national 
laboratories. 

However, one expert questioned if LANL 
would be so technology driven that it would 
have difHcuIty acting as distance learning's na- 
tional leader. In response, an administrator 
from the Laboratory said that he did not be- 
lieve that the Laboratory is technology driven 
and that distance learning deals with a wide 
range of technologies. Shortages in those 
technologies hold the secret to bringing 



distance learning to fruition and sharing those 
answers with a broaucf class of people, which 
falls in the realm of technology transfer and 
would justuy the Laboratoiy's role. 

Center 

We are recominending the establishment 
of a center so that we can collaboratively seek 
funding and produce research. A mixture of 
academia, industry, government, and the mili- 
taty is valuable and should be exploited for the 
advancement of distance learning. There must 
be many examples of cooperation between ed- 
ucational institutions and the militaty already 
in existence. How do we find them and then 
how do we become less invisible to them? 

Its advocates should not be working in 
isolation. Our country ah eady has the i 
sources; they need to be organized properly, 
which docs not require extraordinary sums of 
money. We need efficiency in funding re- 
search. We also need to be centralized in our 
effort, not diffused. On the other hand, one 
member of the group felt that the center 
should not be a place but a group of decen- 
tralized people. 

Resources 

We have content resources and incredible 
communication resources, unrivaled anywhere 
else in the worldv What we do not have is a 
body of scholarly work, a codified distance 
learning knowledge base, such as a distance 
learning textbook. There is more research 
than we have been able to ass ^mble. We need 
to establish data on how this body of knowl- 
edge actually \/orks before we can establish 
ourselves. We have the resources; we need a 
national effort to consolidate these elements. 

Satellite technology makes it easy to cross 
over state lines. What we need is a *'pip^4ine" 
that is analogous to a computer network that 
would facilitate distance learning communi- 
cation. Participants suggested that Los Alamos 
National Laboratory could set up such a net- 
work. Such a center would facilitate com- 
munications among diverse groups, including 
the military and academia. 



Qf^ lance Learning Conference Proceedings, Fall 1989 



47 



Ixtt Alamos National laboratory 



ERIC 



53 



Sttinmaiy 

This feehng of urgency was at the heart of the group sentiment. In other words, we need a re* 
birth, a vision, a sense of going to the moon. Participants recognized a crisis in education, which is 
not a new or unique thought, but one reinforced by the combined experiences of this multifaceted 
group comprised of education, industry, military, and government rq)resentative& 

Although there is a perceived crisis, it is not considered &n emergency. In spite of many nega* 
tive interacting factors, this situation could be improved, and many positive projects are already 
underway* What is^ required is a concerted effort to bring the resources of the nation to bear or 
this problem in a coordinated and focused way. There is a call to arms: the need for a display of 
national-level leadership supported by grassroots efforts across the country. 

The top leadership of the country, the president and key members of Congress, are already vo- 
cally supportive. Now is the time to press forward with initiatives and establish a ground swell that 
can capitalize on that hard-earned advantage. 

Distance learning is not a panacea. Future efforts must be coordinated with traditional school 
systems that will continue to be the cornerstone of our basic education in America. The mission is 
to enhance, not compete, with existing institutions. Complementary roles will reduce the fear of 
change while providing for the needs of ail sectors of our communities. 
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Epilogue 



Participants left the conference with an overwhelming impression of urgency and commitment 
to market the distance learning concept b^ond specific institutions and provincial interests. We 
have a technology to sell and should not be working in isolation! We must convince the bureauc- 
racy at the state and national levels that distance lean 'ng works. Furthermore, we must focus on a 
broader implementation of distance learning in the home, for asynchronous presentations, and for 
integration of technologies into the field. 

American education is in a crisis. We cannot afford enough teachers to ensure that every 
learner can fulfill his/her potential, much less have a tutor or classic apprenticeship relationship. 
Even to maintain the status quo, the need for knowledge, skill, and abUity acquisition will continue 
to grow. Distance learning provides a solution. At the conference, people examined particular 
technologies as solutions to these problems and acknowledged that distributed training systems are 
capable of integrating technology. 

Distance learning offers a low political risk with a high political payoff as well as moderate to 
high technical risks and potentially high technical payoffs for the nation. 

In conclusion, the conference assembled people of varying backgrounds and interests, ex- 
panded horizons, gave direction to distance learning advocates, created a valuable network among 
participants, and inspired further cooperation to advance this exciting field. 

Distance learning is a significant component for solving the American education crisis. All 
communities must work together to implement this solution, prove that distance learning is justifi- 
able, and work enthusiastically to demonstrate the value of lifelong learning. 
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